← all repositories
AmazingAng/old-coder

Make AI Code Run the Gauntlet So You Don't Have To Read It

A markdown skill that forces coding agents to prove their work through mutation testing, property checks, and coverage gauntlets, then hand you an evidence report instead of raw code.

665 stars Python Coding Assistants
old-coder
Collecting fresh signals — velocity needs a few days of history.
collecting data…
star history

What it does

old-coder is a plain-markdown skill that instructs AI coding agents to stop dumping code for human review and instead run it through a brutal verification pipeline. Before writing a line of implementation, the agent must draft a SPEC test plan for your approval; after coding, it delivers an EVIDENCE report summarizing test results, coverage, mutation scores, and supply-chain checks. You read two documents instead of hundreds of lines of agent-generated Python.

The interesting bit

The methodology is essentially extreme TDD adapted for an era where code volume is infinite and attention is not. It explicitly borrows from Uncle Bob’s strategy of surrounding agents with constraints—unit tests, Gherkin, mutation testing, property-based fuzzing—until the only rational move is to produce correct code. The demo rate limiter even caught real defects and an unsound mutation runner when rerun in a fresh context, which is either a bug or a surprisingly honest feature.

Key highlights

  • Agent-agnostic: works with Claude Code, Cursor, Codex CLI, Aider, or custom loops via SKILL.md and AGENTS.md.
  • Risk-calibrated gauntlet: a typo fix gets light checks; anything touching money, auth, or concurrency runs the full suite plus hostile-input probing.
  • Rigid honesty rules: agents must label unverified checks as unverified, cannot weaken tests to force passes, and must disclose if the spec lacked human approval.
  • Includes a working demo rate limiter with published evidence: 41 tests, 100% statement/branch coverage, and 22 of 22 planted bugs caught by mutation testing.
  • Evidence reports bounded confidence rather than absolute proof, explicitly acknowledging that the gauntlet cannot validate its own checkers or prove spec completeness.

Caveats

  • The gauntlet is only as good as the spec you approve; it cannot catch missing requirements or authenticate its own tooling.
  • The README admits the demo’s earlier “green” evidence contained real behavioral defects that only surfaced during fresh-context reruns, so trust but verify (and rerun).
  • It is a process and a prompt template, not an installable framework; adoption requires agent cooperation rather than package installation.

Verdict

Worth adopting if you are drowning in AI-generated code and want to replace line-by-line review with auditable, rerunnable proof. Skip it if you expected a testing library; this is discipline dressed up as markdown.

Frequently asked

What is AmazingAng/old-coder?
A markdown skill that forces coding agents to prove their work through mutation testing, property checks, and coverage gauntlets, then hand you an evidence report instead of raw code.
Is old-coder open source?
Yes — AmazingAng/old-coder is open source, released under the MIT license.
What language is old-coder written in?
AmazingAng/old-coder is primarily written in Python.
How popular is old-coder?
AmazingAng/old-coder has 665 stars on GitHub.
Where can I find old-coder?
AmazingAng/old-coder is on GitHub at https://github.com/AmazingAng/old-coder.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.