The Agnostic AI Gateway Orchestrating LLM Flows in FastAPI
Released 9/2026
By Reindert-Jan Ekker
MP4 | Video: h264, 1280x720 | Audio: AAC, 44.1 KHz, 2 Ch
Level: Advanced | Genre: eLearning | Language: English + subtitle | Duration: 58m 30s | Size: 180.5 MB
Released 9/2026
By Reindert-Jan Ekker
MP4 | Video: h264, 1280x720 | Audio: AAC, 44.1 KHz, 2 Ch
Level: Advanced | Genre: eLearning | Language: English + subtitle | Duration: 58m 30s | Size: 180.5 MB
LLM-powered APIs often become tightly coupled to one provider, making migrations expensive and governance inconsistent.
LLM-powered APIs often become tightly coupled to one provider, making migrations expensive and governance inconsistent.
In this course, The Agnostic AI Gateway: Orchestrating LLM Flows in FastAPI, you'll gain the ability to design and implement a vendor-neutral AI gateway architecture.
First, you'll explore abstraction-driven provider wrappers and intent-based routing.
Next, you'll discover how to normalize provider streaming with SSE and orchestrate parallel operations safely using async task groups.
Finally, you'll learn how to add semantic caching with Redis embeddings plus gateway-level guardrails for prompt injection and PII protection.
When you're finished with this course, you'll have the skills and knowledge of production-ready AI gateway design needed to evolve model strategy without destabilizing your FastAPI application.
Homepage
Code:
https://app.pluralsight.com/ilx/video-courses/agnostic-ai-gateway-orchestrating-llm-flows-fastapi/course-overview
View hidden content is available for registered users!
No Password - Links are Interchangeable