George Hotz | Programming | RL is dumb and doesn't work | Reinforcement Learning LunarLander Part 2
Date of the stream 7 Jan 2024.
from $1250 buy https://comma.ai/shop/comma-3x & best ADAS system in the world https://openpilot.comma.ai
Live-stream chat added as Subtitles/CC - English (Twitch Chat) - at the bottom - Show Transcript
Sources:
- https://github.com/geohot/dumbrl
- https://stable-baselines3.readthedocs.io/en/master/
- https://youtu.be/FVGQJM2MVNY (Deadliest Journeys - Congo: The Last Train in Katanga)
- https://andyljones.com/posts/rl-debugging.html
- https://spinningup.openai.com/en/latest/
- https://arxiv.org/pdf/1912.02875.pdf (Reinforcement Learning Upside Down)
tinygrad bounties:
- https://docs.google.com/spreadsheets/d/1WKHbT-7KOgjEawq5h5Ic1qUWzpfAzuD_J06N1JwOCGs/
Follow for notifications:
- https://twitch.tv/georgehotz
Support George:
- https://twitch.tv/subs/georgehotz
Pre-order tinybox:
- https://buy.stripe.com/5kAaGL6lk9uX9nW144 (https://tinygrad.org/)
Chapters:
00:00:00 intro
00:01:40 stream disclaimer, twitch ban
00:02:45 only 50% of subscription money
00:03:05 kick.com streaming
00:04:45 kick reach out to George, twitch issues
00:06:20 drugs banner, legal in california
00:08:05 50% money to twitch too much, twitch remove the banner
00:09:20 hyubsama food stream, twitch banned users
00:12:00 streaming on X, negotiating power
00:14:40 stream statistics, streaming schedule
00:16:10 applying for twitch partner
00:17:30 twitch revenue
00:18:30 perplexity best way to get banned on twitch
00:22:50 andrew tate impression
00:23:50 stable baselines 3
00:29:40 np.random.randint
00:32:44 NoneType object does not support item assignment
00:33:00 perplexity
00:35:40 render mode defined human
00:37:20 good play, size=10
00:40:30 stable baselines 3 just works
00:50:00 passed a tuple, array element with a sequence
00:51:15 learning
00:52:50 decision transformer stable baselines 3
00:55:20 github.com/geohot/dumbrl
00:56:30 cartpole, stable baselines decision transformer
00:59:30 Jax, wrapper for vectorized environments
01:00:30 deadliest journeys congo, an
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from george hotz archive · george hotz archive · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
comma ai Driving to self racing cars with openpilot
george hotz archive
comma ai Still driving
george hotz archive
comma ai was live
george hotz archive
comma ai Going home
george hotz archive
comma ai We go to the airport
george hotz archive
comma ai Reversing Prius with cabana + panda telethon!
george hotz archive
comma ai panda manufacturing!
george hotz archive
comma ai Self driving to Best Buy
george hotz archive
comma ai shilling for giraffe!
george hotz archive
comma ai Toyota Prius Driving!!!
george hotz archive
comma ai Late night civic driving
george hotz archive
comma ai Toyota giraffe shilling
george hotz archive
comma ai Live car hacking with panda this time or bust!
george hotz archive
comma ai Product launch question time
george hotz archive
comma ai Driving with the RAV4, launching Tuesday!
george hotz archive
comma ai giraffe ship o' clock
george hotz archive
comma ai openpilot 0.3.9
george hotz archive
comma ai EON assembly!
george hotz archive
comma ai Going through the GM investor deck
george hotz archive
comma ai I love my EON
george hotz archive
comma ai RAV4 driving
george hotz archive
comma ai Shilling at the holiday party
george hotz archive
comma ai EON shipping party
george hotz archive
comma ai EON unboxing!
george hotz archive
comma ai The very straight roads of Nevada
george hotz archive
comma ai Starting our trip with openpilot 0.4
george hotz archive
comma ai Little EON on the prairie
george hotz archive
comma ai The urban sprawl of Colorado
george hotz archive
comma ai Onward to Omaha
george hotz archive
comma ai nothing, nowhere
george hotz archive
comma ai shop.comma.ai Buy things!!!
george hotz archive
comma ai The youth are woke
george hotz archive
comma ai Photo shoot!
george hotz archive
comma ai Product announcements are LIT!
george hotz archive
comma ai Breaking down hype of CES
george hotz archive
comma ai Salt Lakes Everywhere!
george hotz archive
comma ai This is the last one
george hotz archive
comma ai Corolla port o’clock!
george hotz archive
comma ai Presentation where it’s like you are in Omaha with us
george hotz archive
comma ai Asking the scopies the banned question
george hotz archive
comma ai Driving in the Corolla!
george hotz archive
comma ai We got new products! shop.comma.ai
george hotz archive
comma ai Sunday w scopies!
george hotz archive
comma ai Our first Lexus, the Lexus RX!
george hotz archive
comma ai Scopie saturday!
george hotz archive
comma ai Panda!
george hotz archive
comma ai Scopie Sunday! *NOT CLICKBAIT*
george hotz archive
comma ai comma Tree!
george hotz archive
comma ai Scopie Saturday
george hotz archive
comma ai Ok scopie Friday
george hotz archive
comma ai comma pedal!
george hotz archive
comma ai okay this time comma pedal!
george hotz archive
comma ai Why aren’t car companies good
george hotz archive
comma ai How can driving be better
george hotz archive
comma ai Scopie Sunday
george hotz archive
comma ai comma got a new car!
george hotz archive
comma ai Mapping Sunday!
george hotz archive
comma ai Let’s go buy a car
george hotz archive
comma ai Ok I take back all the bad things I said about Ford
george hotz archive
comma ai comma smays are in stock!
george hotz archive
More on: LLM Engineering
View skill →Related AI Lessons
⚡
⚡
⚡
⚡
The Download: supercharged scams and studying AI healthcare
MIT Technology Review
I Used AI So Much I Forgot How to Think
Medium · AI
Big Tech firms are accelerating AI investments and integration, while regulators and companies focus on safety and responsible adoption.
Dev.to AI
Cohere and Aleph Alpha announce merger in Berlin, creating a $20 billion transatlantic AI company
The Next Web AI
Chapters (28)
intro
1:40
stream disclaimer, twitch ban
2:45
only 50% of subscription money
3:05
kick.com streaming
4:45
kick reach out to George, twitch issues
6:20
drugs banner, legal in california
8:05
50% money to twitch too much, twitch remove the banner
9:20
hyubsama food stream, twitch banned users
12:00
streaming on X, negotiating power
14:40
stream statistics, streaming schedule
16:10
applying for twitch partner
17:30
twitch revenue
18:30
perplexity best way to get banned on twitch
22:50
andrew tate impression
23:50
stable baselines 3
29:40
np.random.randint
32:44
NoneType object does not support item assignment
33:00
perplexity
35:40
render mode defined human
37:20
good play, size=10
40:30
stable baselines 3 just works
50:00
passed a tuple, array element with a sequence
51:15
learning
52:50
decision transformer stable baselines 3
55:20
github.com/geohot/dumbrl
56:30
cartpole, stable baselines decision transformer
59:30
Jax, wrapper for vectorized environments
1:00:30
deadliest journeys congo, an
🎓
Tutor Explanation
DeepCamp AI