The AI Engineering Program: Module 6 of 13
LLM Application Engineering
Build and ship an LLM-powered service that returns reliable, structured results, with cost and latency under control.
30guided hours
12lessons
Onlineself-paced
Lessons
Every lesson: deep notes, curated lectures, an animated explainer, a hands-on lab, practice questions and a timed exam.
- How LLMs are served: tokens, context windows, sampling, cost and latency maths
- One client for many models: free-tier APIs and local models
- Prompts that hold up: instructions, examples, delimiters and prompt versioning
- Structured outputs: JSON schemas, Pydantic validation and retries
- Function calling and tool use
- Context engineering: deciding what goes into the window
- Multimodal inputs: images, PDFs and speech
- Streaming, caching, rate limits and fallbacks
- Serving an AI feature with FastAPI
- Front ends for AI apps: Streamlit, then a first look at TypeScript and Next.js
- Privacy and responsible AI, including India's DPDP Act 2023
- Module project
Tools introduced: FastAPI, Pydantic
Module project
Invoice-to-data service: upload GST invoices (image or PDF), get validated JSON, with a FastAPI backend, a simple UI, cost per document measured, deployed on a free tier.