OpenAI vs. DeepSeek: The Distillation Battle Shaping Next-Gen AI

OpenAI vs. DeepSeek: The Distillation Battle Shaping Next-Gen AI

OpenAI accused DeepSeek of inappropriately leveraging their model to perform model distillation. What is this technique, and is it ok to use?
7 mins read
Feb 14, 2025
Share

The latest hype in the AI sphere has included accusations surrounding two heavyweights: OpenAI and DeepSeek.

But unlike the Tyson vs. Paul fight, this battle doesn’t have a clear winner.

Released on January 20th, DeepSeek’s R1 made history within a week, triggering one of the largest single-day losses in US stock market history (a bad day for NVIDIA).

R1’s power play was the fact that it performed nearly as well as OpenAI's most advanced models (and allegedly 1000x cheaper to build than GPT-4).

Now, we have an idea of just how they did it.

The Educative Newsletter
Speedrun your learning with the Educative Newsletter
Level up every day in just 5 minutes!
Level up every day in just 5 minutes. Your new skill-building hack, curated exclusively for Educative subscribers.
Tech news essentials – from a dev's perspective
In-depth case studies for an insider's edge
The latest in AI, System Design, and Cloud Computing
Essential tech news & industry insights – all from a dev's perspective
Battle-tested guides & in-depth case studies for an insider's edge
The latest in AI, System Design, and Cloud Computing

Written By:
Fahim ul Haq
Free Edition
OpenAI's o3-mini: Is it worth trying as a developer?
Is the o3-mini a worthwhile alternative to DeepSeek's accuracy and performance? We break down its strength and compare it with R1.
7 mins read
Feb 24, 2025