← all repositories
calmrocks/ai-engineer-notebooks

Learn AI Engineering by Hand, Not by Wrapper

Runnable Colab notebooks that teach backend engineers the applied-LLM stack through raw API calls, because understanding the loop is the actual job skill.

620 stars Jupyter Notebook LearningLLMOps · EvalAgentsRAG · Search
ai-engineer-notebooks
Collecting fresh signals — velocity needs a few days of history.
collecting data…
star history

What it does

This is a curriculum of self-contained Colab notebooks for backend and full-stack engineers moving into AI Engineer or Forward Deployed Engineer roles. It walks through the full applied-LLM lifecycle—prompting, structured output, tool calling, RAG, agents, fine-tuning, security, and operations—using only raw API calls against the free Groq tier. Each notebook handles its own dependencies and reads API keys from Colab secrets, so you can run everything top-to-bottom without a local environment or a credit card.

The interesting bit

The course is intentionally framework-free: you build the agent loop, RAG pipeline, and eval harness from scratch before touching LangChain or LlamaIndex, which means you learn what the wrappers actually do and when to avoid them. Evaluations are the spine of the curriculum, with a “measure before you tune” habit installed before you build anything complex. The final modules are real case studies—debugging a support assistant in production, running a pipeline-vs-agent cost showdown, and surviving a red-team robustness benchmark—rather than toy demos.

Key highlights

  • Runs entirely on the free Groq API; no credit card required, with optional Colab-GPU appendices for LoRA fine-tuning and serving concepts
  • Covers agents from scratch, MCP, tool design, guardrails, and the SKILL.md progressive-disclosure pattern
  • Evals-first curriculum with golden sets, LLM-as-judge, and regression evals treated as CI
  • Includes prompt-injection defense, LoRA/QLoRA trade-offs, and LLMOps observability
  • OpenAI-compatible patterns throughout, so the skills transfer directly to OpenAI and Anthropic with minimal changes

Caveats

  • LoRA fine-tuning and self-hosted serving are concept-first with optional GPU appendices, because Groq does not host training or serving workloads

Verdict

Backend and full-stack engineers interviewing for AI Engineer or Applied AI roles should start here; if you are looking for a no-code quickstart or a LangChain reference manual, this is not it.

Frequently asked

What is calmrocks/ai-engineer-notebooks?
Runnable Colab notebooks that teach backend engineers the applied-LLM stack through raw API calls, because understanding the loop is the actual job skill.
Is ai-engineer-notebooks open source?
Yes — calmrocks/ai-engineer-notebooks is open source, released under the MIT license.
What language is ai-engineer-notebooks written in?
calmrocks/ai-engineer-notebooks is primarily written in Jupyter Notebook.
How popular is ai-engineer-notebooks?
calmrocks/ai-engineer-notebooks has 620 stars on GitHub.
Where can I find ai-engineer-notebooks?
calmrocks/ai-engineer-notebooks is on GitHub at https://github.com/calmrocks/ai-engineer-notebooks.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.