No Priors Ep.61 | OpenAI's Sora Leaders Aditya Ramesh, Tim Brooks and Bill Peebles
AI-generated videos are not just leveled-up image generators. But rather, they could be a big step forward on the path to AGI. This week on No Priors, the team from Sora is here to discuss OpenAI’s recently announced generative video model, which can take a text prompt and create realistic, visually coherent, high-definition clips that are up to a minute long.
Sora team leads, Aditya Ramesh, Tim Brooks, and Bill Peebles join Elad and Sarah to talk about developing Sora. The generative video model isn’t yet available for public use but the examples of its work are very impressive. However, they believe we’re still in the GPT-1 era of AI video models and are focused on a slow rollout to ensure the model is in the best place possible to offer value to the user and more importantly they’ve applied all the safety measures possible to avoid deep fakes and misinformation. They also discuss what they’re learning from implementing diffusion transformers, why they believe video generation is taking us one step closer to AGI, and why entertainment may not be the main use case for this tool in the future.
Show Notes:
0:00 Sora team Introduction
1:05 Simulating the world with Sora
2:25 Building the most valuable consumer product
5:50 Alternative use cases and simulation capabilities
8:41 Diffusion transformers explanation
10:15 Scaling laws for video
13:08 Applying end-to-end deep learning to video
15:30 Tuning the visual aesthetic of Sora
17:08 The road to “desktop Pixar” for everyone
20:12 Safety for visual models
22:34 Limitations of Sora
25:04 Learning from how Sora is learning
29:32 The biggest misconceptions about video models
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from No Priors: AI, Machine Learning, Tech, & Startups · No Priors: AI, Machine Learning, Tech, & Startups · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
No Priors Ep. 13 | With Jensen Huang, Founder & CEO of NVIDIA
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 8 | With Neeva’s Sridhar Ramaswamy
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 7 | With Stanford Professor Dr. Percy Liang
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 1 | With Noam Brown, Research Scientist at Meta
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 9 | With Perplexity AI’s Aravind Srinivas and Denis Yarats
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 10 | With Copilot's Chief Architect and founder of Minion.AI Alex Graveley
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 11 | With Matei Zaharia, CTO of Databricks
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 12 | With Noam Shazeer
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 14 | With Sarah Guo and Elad Gil
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 2 | With Runway ML’s Cristobal Valenzuela
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 3 | With Stability AI’s Emad Mostaque
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 15 | With Kelvin Guu, Staff Research Scientist, Google Brain
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 4 | With Zipline’s Keller Rinaudo Cliffton
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 16 | With Mustafa Suleyman, Founder of DeepMind and Inflection
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 17 | With Karan Singhal
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 5 | With Huggingface’s Clem Delangue
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 6 | With Daphne Koller from Insitro
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 18 | With Kevin Scott, CTO of Microsoft
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 19 | With Anduril CEO Brian Schimpf
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 20 | With Sarah Guo and Elad Gil
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 21 | With Datadog Co-founder/CEO Olivier Pomel
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 22 | With Instacart CEO Fidji Simo
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 23 | With Snowflake's CEO Frank Slootman
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 24 | With Devi Parikh from Meta
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 25 | With Palantir's CTO Shyam Sankar
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 26 | With Weights & Biases CEO Lukas Biewald
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 27 | With Sarah Guo & Elad Gil
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 28 | With Khan Academy’s Creator Sal Khan
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 28 | With Khan Academy’s Creator Sal Khan (Japanese Version)
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 29 | With Inceptive CEO Jakob Uszkoreit
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 30 | With Vercel CEO Guillermo Rauch
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 31 | With Cerebras CEO Andrew Feldman
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 32 | With NEAR’s Illia Polosukhin
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 33 | With Replit's CEO & Co-Founder Amjad Masad
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 34 | With Ginkgo Bioworks Co-Founder and CEO Jason Kelly
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 35 | With Sarah Guo and Elad Gil
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 36 | With Hubspot's Co-Founder Brian Halligan
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 37 | With Kawal Gandhi
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 38 | With Material Security Co-Founder Ryan Noon
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 39 | With OpenAI Co-Founder & Chief Scientist Ilya Sutskever
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 40 | With Arthur Mensch, CEO Mistral AI
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 41 | With Imbue Co-Founders Kanjun Qiu and Josh Albrecht
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 42 | With Sarah Guo and Elad Gil
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 43 | With Clara Shih, CEO of Salesforce AI
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 44 | With Former Square CEO Alyssa Henry
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 45 | With Reid Hoffman
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 46 | Best of 2023 with Sarah Guo and Elad Gil
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 47 | With Sourcegraph CTO Beyang Liu
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 48 | With Covariant CEO Peter Chen
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 49 | With Shopify VP of Core Product Glen Coates
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 50 | With Stripe Head of Information Emily Glassberg Sands
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 51 | With Notion CEO Ivan Zhao
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 52 | With Pinecone CEO Edo Liberty
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 53 | With AMD CTO Mark Papermaster
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 54 | With Sarah Guo & Elad Gil
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 55 | With Figma CEO Dylan Field
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep 56 | With Baseten CEO and Co-Founder Tuhin Srivastava
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 57 | With LangChain CEO and Co-Founder Harrison Chase
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 58 | The argument for humanoid robots with Brett Adcock from Figure
No Priors: AI, Machine Learning, Tech, & Startups
No Priors Ep. 59 | With Sarah Guo & Elad Gil
No Priors: AI, Machine Learning, Tech, & Startups
More on: Multimodal LLMs
View skill →
Related AI Lessons
⚡
⚡
⚡
⚡
Finally, Quality Control is Coming to the Wild West of Open Models
Medium · LLM
The Honest Truth About AI That Nobody With a Course to Sell Will Tell You
Medium · AI
Üretken Yapay Zeka’ya Kapsamlı Bir Giriş: Tokenlardan Difüzyon Modellerine
Medium · Data Science
Google TPU 8 vs Nvidia: 8t and 8i Specs Explained
Dev.to AI
Chapters (13)
Sora team Introduction
1:05
Simulating the world with Sora
2:25
Building the most valuable consumer product
5:50
Alternative use cases and simulation capabilities
8:41
Diffusion transformers explanation
10:15
Scaling laws for video
13:08
Applying end-to-end deep learning to video
15:30
Tuning the visual aesthetic of Sora
17:08
The road to “desktop Pixar” for everyone
20:12
Safety for visual models
22:34
Limitations of Sora
25:04
Learning from how Sora is learning
29:32
The biggest misconceptions about video models
🎓
Tutor Explanation
DeepCamp AI