Does GPT Have Holden Worried?

Dwarkesh Patel · Intermediate ·🧠 Large Language Models ·3y ago

Key Takeaways

The video discusses recent developments in AI, specifically language models like GPT, and their ability to perform various tasks, making the speaker worried about the potential risks and unpredictability of these systems.

Full Transcript

I definitely think that recent developments in AI have made me a bit more freaked out and even since I wrote the most important Century series and before that there were years when open philanthropy was very interested in AI risk but it's become more so as we've seen the progress in AI what we're seeing is we're seeing these very simple systems and is able to do a lot of different tasks this very simple language model that just predicts the next word it's going to see in a stream of text people have gotten it to tell stories people got it to analyze and explain jokes people have gotten it to play kind of role-playing games write poetry write lyrics answer multiple choice questions answer trivia questions and one of the results that I found most ridiculous is strange was this thing called Minerva where people took one of these language models and with very little intervention very little special intervention they got it to do these like difficult math problems and explain its reasoning and get them right about half the time and so I think that's we just see AI systems having all these unpredictable human-like abilities just from having this very simple training procedure and that is something I find wild and scary I don't know exactly where it's going or how fast
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Dwarkesh Patel · Dwarkesh Patel · 42 of 60

1 Rubik's Cube Encryption Demo
Rubik's Cube Encryption Demo
Dwarkesh Patel
2 Bryan Caplan - Nurturing Orphaned Ideas, Education, and UBI
Bryan Caplan - Nurturing Orphaned Ideas, Education, and UBI
Dwarkesh Patel
3 Matjaž Leonardis - Science, Identity and Probability
Matjaž Leonardis - Science, Identity and Probability
Dwarkesh Patel
4 Robin Hanson - The Long View and The Elephant in the Brain
Robin Hanson - The Long View and The Elephant in the Brain
Dwarkesh Patel
5 Caleb Watney - America's Innovation Engine
Caleb Watney - America's Innovation Engine
Dwarkesh Patel
6 Alex Tabarrok - Prizes, Prices, and Public Goods
Alex Tabarrok - Prizes, Prices, and Public Goods
Dwarkesh Patel
7 Scott Young - Ultralearning, The MIT Challenge
Scott Young - Ultralearning, The MIT Challenge
Dwarkesh Patel
8 Scott Aaronson - Quantum Computing, Complexity, and Creativity
Scott Aaronson - Quantum Computing, Complexity, and Creativity
Dwarkesh Patel
9 Uncle Bob - The Long Reach of Code, Automating Programming, and Developing Coding Talent
Uncle Bob - The Long Reach of Code, Automating Programming, and Developing Coding Talent
Dwarkesh Patel
10 Michael Huemer - Anarchy, Capitalism, and Progress
Michael Huemer - Anarchy, Capitalism, and Progress
Dwarkesh Patel
11 Sarah Fitz-Claridge - Taking Children Seriously | The Lunar Society #15
Sarah Fitz-Claridge - Taking Children Seriously | The Lunar Society #15
Dwarkesh Patel
12 Byrne Hobart - Optionality, Stagnation, and Secret Societies
Byrne Hobart - Optionality, Stagnation, and Secret Societies
Dwarkesh Patel
13 David Deutsch - AI, America, Fun, & Bayes
David Deutsch - AI, America, Fun, & Bayes
Dwarkesh Patel
14 Bryan Caplan - Labor Econ, Poverty, & Mental Illness
Bryan Caplan - Labor Econ, Poverty, & Mental Illness
Dwarkesh Patel
15 Jimmy Soni - Peter Thiel, Elon Musk, and the Paypal Mafia
Jimmy Soni - Peter Thiel, Elon Musk, and the Paypal Mafia
Dwarkesh Patel
16 Razib Khan - Genomics, Intelligence, and The Church of Science
Razib Khan - Genomics, Intelligence, and The Church of Science
Dwarkesh Patel
17 Pradyu Prasad - Imperial Japan, the God Emperor, and Militarization in the Modern World
Pradyu Prasad - Imperial Japan, the God Emperor, and Militarization in the Modern World
Dwarkesh Patel
18 Manifold Markets Founder - Predictions Markets & Revolutionizing Governance
Manifold Markets Founder - Predictions Markets & Revolutionizing Governance
Dwarkesh Patel
19 Ananyo Bhattacharya - John von Neumann, Jewish Genius, and Nuclear War
Ananyo Bhattacharya - John von Neumann, Jewish Genius, and Nuclear War
Dwarkesh Patel
20 Agustin Lebron - Trading, Crypto, and Adverse Selection
Agustin Lebron - Trading, Crypto, and Adverse Selection
Dwarkesh Patel
21 Sam Bankman-Fried - Crypto, FTX, Altruism, & Leadership
Sam Bankman-Fried - Crypto, FTX, Altruism, & Leadership
Dwarkesh Patel
22 Alexander Mikaberidze - Napoleon, War, Progress, and Global Order
Alexander Mikaberidze - Napoleon, War, Progress, and Global Order
Dwarkesh Patel
23 Sam Bankman-Fried On FOCUS
Sam Bankman-Fried On FOCUS
Dwarkesh Patel
24 Sam Bankman-Fried on GREAT FOUNDERS
Sam Bankman-Fried on GREAT FOUNDERS
Dwarkesh Patel
25 $30 BILLION Opportunity Ignored by Sam Bankman-Fried Competitors
$30 BILLION Opportunity Ignored by Sam Bankman-Fried Competitors
Dwarkesh Patel
26 Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Dwarkesh Patel
27 Joseph Carlsmith - Utopia, AI, & Infinite Ethics
Joseph Carlsmith - Utopia, AI, & Infinite Ethics
Dwarkesh Patel
28 Will MacAskill - Longtermism, Effective Altruism, History, & Technology
Will MacAskill - Longtermism, Effective Altruism, History, & Technology
Dwarkesh Patel
29 Steve Hsu - Intelligence, Embryo Selection, & The Future of Humanity
Steve Hsu - Intelligence, Embryo Selection, & The Future of Humanity
Dwarkesh Patel
30 Austin Vernon - Energy Superabundance, Starship Missiles, & Finding Alpha
Austin Vernon - Energy Superabundance, Starship Missiles, & Finding Alpha
Dwarkesh Patel
31 Charles C. Mann - Americas Before Columbus & Scientific Wizardry
Charles C. Mann - Americas Before Columbus & Scientific Wizardry
Dwarkesh Patel
32 Tyler Cowen - Why Society Will Collapse & Why Sex is Pessimistic
Tyler Cowen - Why Society Will Collapse & Why Sex is Pessimistic
Dwarkesh Patel
33 Bryan Caplan - Feminists, Billionaires, and Demagogues
Bryan Caplan - Feminists, Billionaires, and Demagogues
Dwarkesh Patel
34 Brian Potter - Future of Construction, Ugly Modernism, & Environmental Review
Brian Potter - Future of Construction, Ugly Modernism, & Environmental Review
Dwarkesh Patel
35 Kenneth T. Jackson - Robert Moses, Hero of New York?
Kenneth T. Jackson - Robert Moses, Hero of New York?
Dwarkesh Patel
36 Edward Glaeser - Cities, Terrorism, Housing, & Remote Work
Edward Glaeser - Cities, Terrorism, Housing, & Remote Work
Dwarkesh Patel
37 Byrne Hobart - FTX, Drugs, Twitter, Taiwan, & Monasticism
Byrne Hobart - FTX, Drugs, Twitter, Taiwan, & Monasticism
Dwarkesh Patel
38 Nadia Asparouhova — Tech elites, democracy, open source, & philanthropy
Nadia Asparouhova — Tech elites, democracy, open source, & philanthropy
Dwarkesh Patel
39 Bethany McLean — Enron, FTX, 2008, Musk, frauds, & visionaries
Bethany McLean — Enron, FTX, 2008, Musk, frauds, & visionaries
Dwarkesh Patel
40 Holden Karnofsky — History's most important century
Holden Karnofsky — History's most important century
Dwarkesh Patel
41 $30m Grant to OpenAI?
$30m Grant to OpenAI?
Dwarkesh Patel
Does GPT Have Holden Worried?
Does GPT Have Holden Worried?
Dwarkesh Patel
43 Lars Doucet — Progress, poverty, Georgism, & why rent is too damn high
Lars Doucet — Progress, poverty, Georgism, & why rent is too damn high
Dwarkesh Patel
44 Deep Learning Changes Everything
Deep Learning Changes Everything
Dwarkesh Patel
45 Garett Jones — Immigration, national IQ, & less democracy
Garett Jones — Immigration, national IQ, & less democracy
Dwarkesh Patel
46 Marc Andreessen — AI, crypto, 1000 Elon Musks, regrets, vulnerabilities, & managerial revolution
Marc Andreessen — AI, crypto, 1000 Elon Musks, regrets, vulnerabilities, & managerial revolution
Dwarkesh Patel
47 Why You Shouldn't Start A Startup
Why You Shouldn't Start A Startup
Dwarkesh Patel
48 The Future Of Venture Capital
The Future Of Venture Capital
Dwarkesh Patel
49 The Crucial Skill For A Startup Founder
The Crucial Skill For A Startup Founder
Dwarkesh Patel
50 Brett Harrison — FTX US former president speaks out
Brett Harrison — FTX US former president speaks out
Dwarkesh Patel
51 Nat Friedman (Github CEO) — Reading ancient scrolls, open source, & AI
Nat Friedman (Github CEO) — Reading ancient scrolls, open source, & AI
Dwarkesh Patel
52 Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
Dwarkesh Patel
53 Impact of Taiwan Invasion on AI
Impact of Taiwan Invasion on AI
Dwarkesh Patel
54 Reliability is Bottleneck on AI - OpenAI Founder
Reliability is Bottleneck on AI - OpenAI Founder
Dwarkesh Patel
55 Next Token Prediction SOLVES AI Says OpenAI Founder
Next Token Prediction SOLVES AI Says OpenAI Founder
Dwarkesh Patel
56 Harmful Uses of GPT - OpenAI Founder
Harmful Uses of GPT - OpenAI Founder
Dwarkesh Patel
57 Why OpenAI Founder Thinks AI Is Near
Why OpenAI Founder Thinks AI Is Near
Dwarkesh Patel
58 AI will help us achieve enlightenment -  OpenAI Founder
AI will help us achieve enlightenment - OpenAI Founder
Dwarkesh Patel
59 Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality
Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality
Dwarkesh Patel
60 Richard Rhodes — The making of the atomic bomb
Richard Rhodes — The making of the atomic bomb
Dwarkesh Patel

The video explores the capabilities and limitations of language models like GPT, highlighting their ability to perform various tasks and the potential risks and unpredictability associated with these systems. The speaker discusses recent developments in AI and their implications for the future. Viewers can learn about the current state of LLMs and the importance of considering their potential risks and limitations.

Key Takeaways
  1. Explore LLM capabilities
  2. Analyze LLM limitations
  3. Evaluate LLM risks
  4. Design effective prompts
  5. Test prompt variations
  6. Optimize prompt performance
💡 The simplicity of LLM training procedures can lead to unpredictable and human-like abilities, making it essential to consider the potential risks and limitations of these systems.

Related Reads

📰
LLMs Cannot Be Audited. In Compliance, That Is the Problem.
LLMs are being used for tax and compliance queries, but their lack of auditability poses a significant problem
Medium · Data Science
📰
Don't Fragment My AI Stack: Why Shutting Off Chinese Open-Weight Models Is a Bad Idea
Learn why shutting off Chinese open-weight models can fragment AI stacks and hinder innovation, and how developers can advocate for open access to AI models.
Dev.to · Hanzla Baig
📰
Marking the Wrong Symptoms: Evaluating LLM Watermarks in Medical Texts
Learn how LLM watermarks impact medical texts and why evaluating them is crucial for reliable traceability in clinical workflows
ArXiv cs.AI
📰
ClickGuard: Detecting and Spoiling Clickbait News with Informativeness Measures and Large Language Models
Learn how ClickGuard uses large language models and informativeness measures to detect clickbait news and improve online browsing experience
ArXiv cs.AI
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →