← all repositories
BBuf/AI-Infra-Auto-Driven-SKILLS

Operational memory for AI-infra agents, in plain markdown

A repo of SKILL.md directories that hands coding agents the hard-won procedures of LLM serving work — benchmarking, profiler triage, and 118 model PR histories.

Collecting fresh signals — velocity needs a few days of history.
star history

What it does It packages 11 skills as plain SKILL.md directories that any skill-capable agent runtime (Claude Code, Codex, Kimi) can load. The skills cover cross-framework serving benchmarks (SGLang, vLLM, TensorRT-LLM, TokenSpeed), torch profiler analysis, capacity planning, model Day-0 support, PR review, and incident triage. Alongside them sits a queryable knowledge base of 118 bilingual model dossiers — SGLang 45, vLLM 44, TensorRT-LLM 15, TokenSpeed 14 — mapping each model family to the PRs that touched it.

The interesting bit The PR history database is the standout: before you patch a model path or claim an optimization is new, you can check what upstream already did, with per-PR evidence cards and audit dates. The repo is also honest about provenance — generated entries are marked as pending manual diff review, and a source refresh is explicitly not a GPU rerun.

Key highlights

  • Fair-benchmark skill pins model, framework commit, GPUs, workload, and SLA for every comparison row
  • Profiler skills keep prefill and decode separate and check findings against a catalog of known optimizations
  • Day-0 support skill turns a new architecture into an SGLang PR DAG with a validation matrix
  • Explainer-video skill converts SGLang PRs or articles into narrated Chinese videos with bilingual captions
  • Kernel campaigns live in the sibling KDA-Pilot repo, keeping this one focused on procedures and history

Caveats

  • The PR dossiers are regenerated from git history, and new generated entries await manual diff review — treat them as leads, not gospel
  • Strongly SGLang-centric in the review, incident, and Day-0 skills; the other frameworks mostly appear in benchmarks and histories

Verdict Worth a look if you run inference infrastructure and want your agent to stop rediscovering known optimizations. If you’re not in the SGLang/vLLM serving trenches, it’s a well-organized curiosity.

Frequently asked

What is BBuf/AI-Infra-Auto-Driven-SKILLS?
A repo of SKILL.md directories that hands coding agents the hard-won procedures of LLM serving work — benchmarking, profiler triage, and 118 model PR histories.
Is AI-Infra-Auto-Driven-SKILLS open source?
Yes — BBuf/AI-Infra-Auto-Driven-SKILLS is an open-source project tracked on heatdrop.
What language is AI-Infra-Auto-Driven-SKILLS written in?
BBuf/AI-Infra-Auto-Driven-SKILLS is primarily written in Python.
How popular is AI-Infra-Auto-Driven-SKILLS?
BBuf/AI-Infra-Auto-Driven-SKILLS has 1k stars on GitHub.
Where can I find AI-Infra-Auto-Driven-SKILLS?
BBuf/AI-Infra-Auto-Driven-SKILLS is on GitHub at https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.