What it does

AI Engineer Coach is a VS Code extension that ingests your local AI coding session logs—regardless of which tool generated them—and surfaces dashboards, anti-pattern detection, and progress tracking. Everything stays on your machine; no telemetry leaves the building. It reads, it scores, it nags constructively.

The interesting bit

The project treats AI assistance as a skill to be measured and refined, not just a button to mash. It ships 45 editable markdown rules for detecting prompt anti-patterns, a REPL for testing rule logic against your own data, and even gamifies the experience with Bronze-to-Diamond achievements. The “agentic readiness” angle—scoring how well you set up context for AI agents—feels like a bet on where coding assistants are heading, not where they are.

Key highlights

• Works with “any harness” (the README’s phrasing); parses local logs from multiple AI tools into one unified dashboard
• 45 detection rules across prompt quality, session hygiene, code review, tool mastery, and context management
• Rule Editor and Rule Playground for authoring, tuning, and live-testing custom detection logic
• Skill Finder identifies repeated prompts and suggests reusable community skills
• Context Health scoring with workspace context maps and AI-powered instruction-file review (uses Copilot LM API only when explicitly invoked)
• Learning Center generates personalized quizzes from your actual usage patterns

Caveats

• Token breakdown and monthly burndown features are noted as “temporarily hidden” and “temporarily disabled” in the README
• Requires manual VSIX installation; no marketplace release path is mentioned
• Explicitly disclaimed as “not an official Microsoft product” despite the Microsoft GitHub org

Verdict

Worth a look if you’re heavy enough into AI-assisted coding that you’ve wondered whether you’re improving or just automating your bad habits. Skip it if you want turnkey polish or don’t generate enough session logs to make the analysis meaningful.