The AI Engineering Program: Module 6 of 13

LLM Application Engineering

Build and ship an LLM-powered service that returns reliable, structured results, with cost and latency under control.

30guided hours
12lessons
Onlineself-paced

Lessons

Every lesson: deep notes, curated lectures, an animated explainer, a hands-on lab, practice questions and a timed exam.

  1. How LLMs are served: tokens, context windows, sampling, cost and latency maths
  2. One client for many models: free-tier APIs and local models
  3. Prompts that hold up: instructions, examples, delimiters and prompt versioning
  4. Structured outputs: JSON schemas, Pydantic validation and retries
  5. Function calling and tool use
  6. Context engineering: deciding what goes into the window
  7. Multimodal inputs: images, PDFs and speech
  8. Streaming, caching, rate limits and fallbacks
  9. Serving an AI feature with FastAPI
  10. Front ends for AI apps: Streamlit, then a first look at TypeScript and Next.js
  11. Privacy and responsible AI, including India's DPDP Act 2023
  12. Module project

Tools introduced: FastAPI, Pydantic

Module project

Invoice-to-data service: upload GST invoices (image or PDF), get validated JSON, with a FastAPI backend, a simple UI, cost per document measured, deployed on a free tier.