Grokking the Generative AI System Design*

brief summary

Intermediate

126 Lessons

1h

Certificate of Completion

brief summary

AI-POWERED LEARNING

Explanations

AI-POWERED LEARNING

Explanations
Course Overview
Course Content

Course Overview

summary

Course Content

1.

Introduction to GenAI System Design

The New Hybrid Discipline
From Training to Reality
Step 1: The Heavy Lifting
Step 2: The System Design
Step 3: Real-World Delivery
Lab vs. Production
Why Design Matters?
Quick Recap
2.

Fundamental Concepts in GenAI

The Brain of AI
Evolution of Architectures
RNNs: The Memory Loop
Transformers: Attention is All You Need
How Attention Works
Tokens: Chopping Text
Embeddings as Meaning
Why We Need Many GPUs
Parallelism: Data vs Model
Making Models Faster
Speed Trick: Quantization
Speed Trick: Distillation
Choosing the Right Cache
Why Evaluation Is Hard
Quality Metrics Snapshot
Do Metrics Replace Humans?
GenAI Fundamentals Recap
3.

Back-of-the-Envelope Calculations

The Art of Estimation
FLOPS in One Step
Neural Network Parameters
What Is a Forward Pass?
What Is a Backward Pass?
FLOPS per Parameter
Training Time Formula
Quick Check: Training Factors
Estimating Model Storage
Precision vs. Size Tradeoff
Estimating Server Count
BOTEC Cheat Sheet
4.

Systematic Framework for Designing GenAI Systems

Taming GenAI Complexity
The SCALED Framework
System Requirements
Choose AI Model
Acquire Data
Leverage Model
Estimate Resources
Design System
Model Size Trade-offs
The Data Quality Rule
SCALED Recap
5.

System Design of a Text-to-Text Generation System

How Machines Understand Us
A Sample User Message
Spotting the User’s Goal
Picking Out Key Details
Reading the Emotion
Big vs. Small Models
Training Takes Time
Serving 100M Users
Three-Part AI Pipeline
Step 1: Prompt Processing
Step 2: Long-Term Memory
Step 3: Model and Safety
Vector Databases 101
Safety Check Quiz
Recap: Text-to-Text System
6.

System Design of a Text-to-Image Generation System

14 Lessons

7.

System Design of a Text-to-Speech Generation System

15 Lessons

8.

System Design of a Text-to-Video Generation System

13 Lessons

9.

System Design of an Image Captioning System

13 Lessons

10.

Conclusion

8 Lessons

Trusted by 1.4 million developers working at companies

Anthony Walker

@_webarchitect_

Evan Dunbar

ML Engineer

Carlos Matias La Borde

Software Developer

Souvik Kundu

Front-end Developer

Vinay Krishnaiah

Software Developer

Eric Downs

Musician/Entrepeneur

Kenan Eyvazov

DevOps Engineer

Souvik Kundu

Front-end Developer

Eric Downs

Musician/Entrepeneur

Anthony Walker

@_webarchitect_

Evan Dunbar

ML Engineer

Hands-on Learning AI-Powered Learning

See how Educative uses AI to make your learning more immersive than ever before.

AI Prompt

Build prompt engineering skills. Practice implementing AI-informed solutions.

Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

Explain

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

FOR TEAMS

Interested in this course for your business or team?

Unlock this course (and 1,000+ more) for your entire org with DevPath