← all repositories
rohitg00/ai-engineering-from-scratch

Build AI from raw math before you’re allowed to use PyTorch

This curriculum closes the gap between calling AI APIs and understanding the loss curves underneath.

42.3k stars Python LearningAgentsLLMOps · Eval
ai-engineering-from-scratch
Velocity · 7d
+670
★ / day
Trend
accelerating
star history

What it does

This is a free, open-source curriculum that teaches AI engineering end-to-end across 20 phases, from linear algebra to autonomous agent swarms. Every lesson follows the same loop: derive the math, build the algorithm by hand in raw Python (or TypeScript, Rust, or Julia), then run it again through a production framework like PyTorch. Each phase ships reusable artifacts—prompts, agent skills, and MCP servers—meant to be pasted into real workflows, not just filed away as homework.

The interesting bit

The pedagogy is deliberately inverted: frameworks appear only after you have written the smaller version yourself. The curriculum also dogfoods its own material by shipping agent skills—such as a placement quiz and per-phase understanding checks—that plug directly into Claude, Cursor, or Codex.

Key highlights

  • 20 stacked phases covering math, deep learning, transformers, LLM engineering, agents, and production infrastructure
  • Every lesson produces a tangible artifact: prompts, skills, autonomous agents, or MCP servers
  • ~320 hours of material, MIT licensed, designed to run on a laptop
  • Four languages supported: Python, TypeScript, Rust, and Julia
  • No video content or hand-holding; each lesson is a self-contained folder with narrative docs and runnable code

Caveats

  • The provided sources show conflicting lesson counts (503 versus 473), suggesting the content is still expanding or shifting.
  • Only the first phase is fully expanded in the README; the depth of completed material for later phases is not visible in the truncated source.

Verdict

Worth bookmarking if you are a developer with patience and a genuine desire to understand AI internals rather than just wire APIs. Skip it if you need a five-minute deploy script or a weekend crash course.

Frequently asked

What is rohitg00/ai-engineering-from-scratch?
This curriculum closes the gap between calling AI APIs and understanding the loss curves underneath.
Is ai-engineering-from-scratch open source?
Yes — rohitg00/ai-engineering-from-scratch is open source, released under the MIT license.
What language is ai-engineering-from-scratch written in?
rohitg00/ai-engineering-from-scratch is primarily written in Python.
How popular is ai-engineering-from-scratch?
rohitg00/ai-engineering-from-scratch has 42.3k stars on GitHub and is currently accelerating.
Where can I find ai-engineering-from-scratch?
rohitg00/ai-engineering-from-scratch is on GitHub at https://github.com/rohitg00/ai-engineering-from-scratch.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.