MLOps & AI Engineering
GPU Deployment
Serve models on GPUs efficiently. Inference servers, vLLM, autoscaling and cost control.
- Advanced
- About 6 hours
- 1 modules
- 5 lessons
- Free
This course is not released yet. We publish courses one at a time, each one complete. The full syllabus is below.
What you will learn
- GPU ServingChoosing a GPU, Inference Servers, Serving LLMs With vLLM and more
Course syllabus
Not released yet · full syllabus below
- 1
GPU Serving
5 lessons- 1Choosing a GPUSoon
- 2Inference ServersSoon
- 3Serving LLMs With vLLMSoon
- 4Autoscaling GPUsSoon
- 5Controlling GPU CostsSoon