On behalf of all humans: Thank you Andrej!
Andrej Karpathy
865K subscribersWe build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 ...
I only just noticed that this is set up in a perfect 2 colum...
262 Comments
TheAIGRID
99.5k views • 1 day ago
Wes Roth
91.1k views • 1 day ago
Wes Roth
11.6k views • 1 day ago
AI For Humans
2.1k views • 2 days ago
Wes Roth
79.9k views • 2 days ago
TheAIGRID
21.2k views • 2 days ago
Wes Roth
10.0k views • 2 days ago
AI For Humans
25.0k views • 3 days ago
TheAIGRID
13.6k views • 3 days ago
Wes Roth
80.3k views • 3 days ago
Shelf will be hidden for 30 daysUndo
Wes Roth
13.8k views • 3 days ago
Wes Roth
24.6k views • 4 days ago
TheAIGRID
8.1k views • 4 days ago
AI For Humans
8.9k views • 5 days ago
Wes Roth
29.3k views • 5 days ago
TheAIGRID
17.6k views • 5 days ago
TheAIGRID
49.3k views • 1 week ago
AI Jason
31.5k views • 1 week ago
Wes Roth
19.4k views • 1 week ago
Wes Roth
15.0k views • 1 week ago
Wes Roth
201.6k views • 1 week ago
TheAIGRID
32.6k views • 1 week ago
Wes Roth
148.3k views • 1 week ago
TheAIGRID
3.3k views • 1 week ago
TheAIGRID
23.5k views • 1 week ago
Wes Roth
45.1k views • 1 week ago
AI Explained
90.5k views • 1 week ago
Wes Roth
17.4k views • 1 week ago
AI For Humans
18.8k views • 1 week ago
Wes Roth
4.9k views • 1 week ago
AI Jason
16.1k views • 1 week ago
Wes Roth
51.5k views • 1 week ago
TheAIGRID
439.3k views • 1 week ago
AI Explained
95.2k views • 1 week ago
Wes Roth
103.7k views • 1 week ago
AI For Humans
25.6k views • 1 week ago
Wes Roth
53.8k views • 1 week ago
AI Jason
7.6k views • 1 week ago
TheAIGRID
31.1k views • 1 week ago
AI For Humans
1.8k views • 1 week ago
AI Explained
74.6k views • 1 week ago
Wes Roth
62.3k views • 1 week ago
TheAIGRID
37.3k views • 2 weeks ago
Wes Roth
9.5k views • 2 weeks ago
Wes Roth
3.0k views • 2 weeks ago
Wes Roth
5.9k views • 2 weeks ago
Wes Roth
13.9k views • 2 weeks ago
TheAIGRID
39.8k views • 2 weeks ago
AI For Humans
13.8k views • 2 weeks ago
Wes Roth
99.4k views • 2 weeks ago
Wes Roth
58.1k views • 2 weeks ago
AI For Humans
1.5k views • 2 weeks ago
TheAIGRID
9.6k views • 2 weeks ago
TheAIGRID
35.8k views • 3 weeks ago
AI For Humans
21.2k views • 3 weeks ago
AI For Humans
1.3k views • 3 weeks ago
TheAIGRID
29.3k views • 3 weeks ago
AI Jason
24.4k views • 3 weeks ago
AI For Humans
1.5k views • 3 weeks ago
AI For Humans
1.7k views • 3 weeks ago
TheAIGRID
11.6k views • 4 weeks ago
TheAIGRID
24.4k views • 1 month ago
AI For Humans
12.7k views • 1 month ago
TheAIGRID
13.6k views • 1 month ago
TheAIGRID
22.0k views • 1 month ago
TheAIGRID
7.6k views • 1 month ago
TheAIGRID
39.1k views • 1 month ago
AI Explained
98.3k views • 1 month ago
TheAIGRID
27.7k views • 1 month ago
AI Explained
60.0k views • 1 month ago
AI For Humans
17.2k views • 1 month ago
TheAIGRID
5.9k views • 1 month ago
TheAIGRID
50.8k views • 1 month ago
AI Jason
45.3k views • 1 month ago
AI For Humans
16.5k views • 1 month ago
AI Explained
92.6k views • 1 month ago
AI Explained
56.7k views • 1 month ago
AI For Humans
10.3k views • 1 month ago
AI Jason
221.8k views • 1 month ago
AI Explained
72.1k views • 1 month ago
AI For Humans
11.3k views • 1 month ago
AI For Humans
3.4k views • 2 months ago
AI Explained
108.0k views • 2 months ago
AI For Humans
14.8k views • 2 months ago
AI Jason
97.6k views • 2 months ago
AI Explained
135.6k views • 2 months ago
AI Explained
93.2k views • 2 months ago
AI For Humans
7.6k views • 2 months ago
AI Jason
211.8k views • 2 months ago
AI For Humans
949 views • 2 months ago
AI Jason
16.2k views • 2 months ago
AI For Humans
987 views • 2 months ago
AI For Humans
1.1k views • 2 months ago
AI Explained
117.1k views • 2 months ago
AI For Humans
11.2k views • 2 months ago
AI Jason
82.4k views • 2 months ago
AI For Humans
1.0k views • 2 months ago
AI Explained
109.7k views • 3 months ago
Andrej Karpathy
1.4M views • 3 months ago
AI Explained
135.2k views • 3 months ago
AI Jason
189.7k views • 3 months ago
AI Explained
111.2k views • 3 months ago
Andrej Karpathy
2.6M views • 3 months ago
AI Jason
14.7k views • 3 months ago
AI Explained
122.8k views • 3 months ago
AI Jason
18.1k views • 3 months ago
AI Explained
107.6k views • 4 months ago
AI Explained
182.7k views • 4 months ago
AI Jason
51.4k views • 4 months ago
AI Explained
106.0k views • 4 months ago
AI Jason
46.6k views • 4 months ago
AI Jason
43.4k views • 4 months ago
AI Explained
108.3k views • 4 months ago
AI Jason
68.1k views • 4 months ago
AI Explained
287.4k views • 5 months ago
Andrej Karpathy
34.7k views • 5 months ago
AI Jason
96.7k views • 5 months ago
AI Explained
87.3k views • 5 months ago
AI Explained
74.9k views • 5 months ago
AI Explained
153.6k views • 5 months ago
AI Explained
116.9k views • 5 months ago
AI Jason
62.6k views • 6 months ago
AI Jason
325.6k views • 7 months ago
AI Jason
151.4k views • 8 months ago
AI Jason
201.3k views • 8 months ago
AI Jason
31.3k views • 8 months ago
AI Jason
19.7k views • 9 months ago
AI Jason
124.6k views • 10 months ago
Andrej Karpathy
811.3k views • 11 months ago
Morningside AI
13.8k views • 1 year ago
Andrej Karpathy
813.6k views • 1 year ago
Morningside AI
4.2k views • 1 year ago
Morningside AI
10.1k views • 1 year ago
Andrej Karpathy
2.8M views • 1 year ago
Morningside AI
26.7k views • 1 year ago
Andrej Karpathy
5.7M views • 2 years ago
Andrej Karpathy
223.2k views • 2 years ago
Andrej Karpathy
268.3k views • 2 years ago
Andrej Karpathy
384.0k views • 2 years ago
Andrej Karpathy
423.4k views • 2 years ago
262 Comments
i did it
[pound pound pound]
derives from a mandate from the masses, accompanied by force!
TIM: I warned you! Oh, no, you! But did you knew it all,
LAUNCELOT: Ah. Let     See More
hey andrej, this is where i'm lost. what's the point of linearly scaling down from channel embeddings of 32 to 16 head size? why don't we keep this at 32?
This man really has a gift in teaching stuff. Wish I was good at something but I suck at everything, (mediocrity is killing me). But hey, I completed the video feeling like I understood some     See More
fyi for anyone on macbooks, change device = 'cuda' if if torch.cuda.is_available() else 'cpu' to
device = 'cuda' if torch.cuda.is_available() else 'mps     See More
Thank you - this bring sanity to the space by demonstrating exactly how it works. It's not 'magic'. It's not 'human'. It's code. thank you so much.
I only just noticed that this is set up in a perfect 2 column layout so a person can have the script/notebook they are working on side by side with yours and not have to jump around at all.     See More
On behalf of all humans: Thank you Andrej!     See Less
i did it
[pound pound pound]
derives from a mandate from the masses, accompanied by force!
TIM: I warned you! Oh, no, you! But did you knew it all,
LAUNCELOT: Ah. Let     See More ssing me in my liege.
W I warned you listen to beat us. Come on then.
[chord]
LEFT HEAD: Oh, Concorde!
DINGO: In the name of Assyria?
BEDEMIR: Yes, yes, remove the supports!
DENNIS: Witch!
HERBERT: Man!
CROWD: Burn her!    See Less
Come on Andrej!!! I can hardly wait for the next video! We love you man     See Less
This is a fantastically clear explanation, thank you so much!     See Less
You are impressively efficient. This was a blast to watch     See Less
hey andrej, this is where i'm lost. what's the point of linearly scaling down from channel embeddings of 32 to 16 head size? why don't we keep this at 32?     See Less
This man really has a gift in teaching stuff. Wish I was good at something but I suck at everything, (mediocrity is killing me). But hey, I completed the video feeling like I understood some     See More t's nice. Thank you Andrej    See Less
fyi for anyone on macbooks, change device = 'cuda' if if torch.cuda.is_available() else 'cpu' to
device = 'cuda' if torch.cuda.is_available() else 'mps     See More h.backends.mps.is_available() else 'cpu'
anyone else can make this change too, just makes it so the device checks for m1 gpu availability too before it reverts to cpu    See Less
Thank you - this bring sanity to the space by demonstrating exactly how it works. It's not 'magic'. It's not 'human'. It's code. thank you so much.     See Less
I only just noticed that this is set up in a perfect 2 column layout so a person can have the script/notebook they are working on side by side with yours and not have to jump around at all.     See More ;s clean and clutter free. That is some classy action, my deepest respect and gratitude.    See Less