the forge · prompt tooling
Prompt engineering,
Prompt engineering,
treated like engineering.
Version control, regression testing, structural grading, and adversarial fuzzing — for prompts.
01 · versioning & regression
promptforge.py
Snapshot your prompt, lock test cases, run the full suite on every change. Never ship a silent regression.
python3 promptforge.py snapshot
python3 promptforge.py test default
02 · structural grading
grader.py
Seven checks against known failure modes: output contracts, fallbacks, role anchors, injection surface, vague language. Every FAIL comes with the mechanism.
python3 grader.py prompts/default.md
03 · adversarial fuzzing
fuzz.py
Mutation families for the real attacks: instruction override, role-flip, prompt leak, delimiter smuggling. Find the holes before they're used.
python3 fuzz.py prompts/default.md "test input"