Chapter index
All lessons.
59 of 59 lessons
AI & ML Foundations
- AI & ML Orientation
What AI and ML are, how learning differs from rules, and how to choose a first path.
Basic - Python & NumPy for ML
Write small Python programs and reason about arrays, shapes, vectorization, and reproducible experiments.
Basic - Data Exploration & Preprocessing
Inspect real data, handle missing values, encode features, avoid leakage, and build repeatable transformations.
Basic - Calculus & Gradients
Understand slopes, partial derivatives, the chain rule, and gradient descent through visual and coded experiments.
Basic - ML Workflow & Evaluation
Frame a problem, split data correctly, choose metrics, detect overfitting, and compare against a baseline.
Basic - Responsible AI Foundations
Translate fairness, privacy, safety, transparency, and human oversight into testable design decisions.
Basic - Logistic Regression
Build an interpretable binary classifier using logits, sigmoid probabilities, cross-entropy, and thresholds.
Basic - Model Evaluation Project
Audit two candidate classifiers and defend a deployment threshold using evidence rather than one headline score.
Basic - Beginner ML Capstone
Take a small tabular problem from question and data audit through model card, test evidence, and deployment recommendation.
Basic
Mathematics & Statistics
- Probability
Understanding randomness and Bayesian vs Frequentist views.
Basic - Distributions
Normal, Binomial, and Poisson distributions.
Basic - Linear Algebra
Vectors, Matrices, Eigenvalues, and SVD.
Basic - Hypothesis Testing
p-values, Z-tests, and T-tests.
Intermediate - Convex Optimization & KKT
Lagrange multipliers, KKT optimality conditions, Slater condition, and duality.
Intermediate
Classical Machine Learning
- Linear Regression
Predicting continuous values using a linear relationship.
Basic - Decision Trees
Hierarchical split-based classification and regression.
Basic - Tree Ensembles
Combine trees with bagging and boosting, evaluate out-of-sample behavior, and diagnose feature importance safely.
Intermediate - SVM
Support Vector Machines for optimal boundary separation.
Intermediate - K-Means Clustering
Unsupervised grouping of data points.
Basic - Statistical Learning Theory
VC Dimension, Rademacher complexity, generalization error bounds, and PAC learning.
Intermediate - Graph Neural Networks (GNNs)
Message passing paradigms, Graph Convolutional Networks (GCN), GraphSAGE, and non-Euclidean graph representations.
Intermediate
Deep Learning
- Neural Networks
The building blocks of deep learning: Perceptrons and MLPs.
Basic - Backpropagation
How neural networks learn using the chain rule.
Intermediate - RNNs & LSTMs
Backpropagation Through Time (BPTT), vanishing gradients, forget gates, and long-range sequence memory.
Intermediate - CNNs
Convolutional Neural Networks for image recognition.
Intermediate - Transformers
The attention mechanism that powers modern AI.
Advanced - Attention Variants & Norms
Grouped-Query Attention (GQA), Multi-Query (MQA), RoPE embeddings, and RMSNorm topology.
Advanced
Generative & Agentic AI
- How LLMs Generate Text
See how a language model predicts, selects, and appends one token at a time.
Basic - LLM Tokenization
Understand how text becomes versioned token IDs, context usage, and model cost.
Basic - Embeddings & Context Windows
Learn how models represent text and how finite context changes application design.
Basic - LLM Decoding & Sampling
Compare greedy decoding, temperature, and top-p through visible probability changes.
Basic - Prompting & In-Context Learning
Write prompts as testable contracts with instructions, examples, data, and output rules.
Basic - LLM Limitations & Grounding
Recognize unsupported output and design evidence, citations, abstention, and evaluation.
Basic - LLMs
Large Language Models and the GPT architecture.
Advanced - RAG
Retrieval Augmented Generation for grounding AI.
Intermediate - RLHF
Reinforcement Learning from Human Feedback.
Advanced - Frontier Reasoning & GRPO
DeepSeek-R1 style Group Relative Policy Optimization, rule-based RL, and test-time compute.
Advanced - Agentic AI
Reasoning loops, tools, and multi-agent systems.
Advanced - Generative Models
GANs, VAEs, and Diffusion Probabilistic Models (DDPM/DDIM).
Advanced - Flow Matching & DiT Video
Rectified Flow matching, optimal transport vector fields, and Patchified Diffusion Transformers (Sora/Flux).
Advanced - State Space Models & Mamba
Continuous-time SSMs, selective scan parameters, discretization, and linear-time sequence modeling.
Advanced - Multimodal AI & CLIP
Contrastive vision-text embeddings, InfoNCE loss, and joint cross-modal representation spaces.
Intermediate - Mixture of Experts (MoE)
Sparse routing mechanisms, gating networks, Top-K dispatch, and auxiliary load balancing.
Advanced - Mechanistic Interpretability
Sparse Autoencoders (SAEs), monosemantic feature dictionaries, circuit analysis, and activation steering.
Advanced
RAG & Knowledge Systems
- Embeddings & Hybrid Search
Tokenization, dense and sparse representations, similarity, ANN indexes, quantization, and rank fusion.
Basic - LLM Interfaces & Structured Outputs
Context construction, prompt contracts, tool calls, schema validation, retries, and observable model APIs.
Intermediate - Knowledge Graphs & Ontologies
RDF triples, Turtle, OWL, SPARQL, SHACL, taxonomies, schemas, and semantic reasoning.
Intermediate - Production RAG & GraphRAG
Chunking, query transformation, hybrid retrieval, reranking, entity resolution, and global graph search.
Advanced - Knowledge-Driven Agent Systems
Ontology-constrained plans, graph-augmented reasoning, live knowledge updates, and enterprise architecture.
Advanced
Agent Engineering & Safety
- Model Context Protocol (MCP)
Clients, servers, tools, resources, prompts, transports, capability negotiation, authorization, and safe execution.
Intermediate - Loop Engineering
Bounded state machines, termination contracts, recovery, idempotency, budgets, no-progress detection, and replayable agent loops.
Advanced - Agent State, Memory & Orchestration
State graphs, checkpoints, working and semantic memory, durable workflows, interrupts, and multi-agent routing.
Advanced - Harness Engineering & Sandboxes
Reproducible execution, containers and microVMs, resource limits, mocks, structured observations, and trace capture.
Advanced - AI Evaluation & Quality Gates
Golden datasets, RAG and agent metrics, offline and online evaluation, regression tests, and CI release gates.
Advanced - Agent Guardrails & Security
Schema controls, prompt-injection defense, least privilege, circuit breakers, budgets, approvals, and incident response.
Advanced
Production AI
- Distributed Training
Parallelism paradigms (DDP, TP, PP, FSDP) and scaling laws.
Advanced - Model Serving
High-throughput LLM hosting, KV caching, vLLM, speculative decoding, and quantization.
Advanced - Quantization & LoRA
Low-Rank Adaptation (ΔW = B·A), rank selection, FP8/INT4 uniform quantization, and scale-zero point math.
Advanced - FlashAttention & GPU Architecture
GPU HBM vs SRAM bandwidth, online softmax tiling, IO-awareness, and Triton CUDA ops.
Advanced