On behalf of all humans: Thank you Andrej!
Andrej Karpathy
458K subscribersWe build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 ...
I only just noticed that this is set up in a perfect 2 colum...
204 Comments
TheAIGRID
22.1k views • 3 days ago
AI Explained
103.0k views • 1 month ago
AI Explained
117.6k views • 1 month ago
TheAIGRID
62.7k views • 1 month ago
Wes Roth
35.0k views • 1 month ago
AI For Humans
5.4k views • 2 months ago
Andrej Karpathy
34.7k views • 2 months ago
TheAIGRID
217 views • 3 months ago
TheAIGRID
48.5k views • 3 months ago
AI For Humans
5.1k views • 3 months ago
Shelf will be hidden for 30 daysUndo
Wes Roth
22.8k views • 3 months ago
AI For Humans
1.0k views • 3 months ago
Wes Roth
75.1k views • 3 months ago
Wes Roth
43.1k views • 3 months ago
Wes Roth
19.1k views • 3 months ago
Wes Roth
6.4k views • 3 months ago
Wes Roth
5.2k views • 3 months ago
Wes Roth
9.0k views • 4 months ago
Wes Roth
15.7k views • 4 months ago
Wes Roth
2.3k views • 4 months ago
Wes Roth
10.8k views • 5 months ago
AI Jason
56.9k views • 5 months ago
Wes Roth
82.8k views • 5 months ago
Wes Roth
17.6k views • 5 months ago
Wes Roth
81.6k views • 5 months ago
Wes Roth
70.8k views • 5 months ago
Wes Roth
183.9k views • 5 months ago
Wes Roth
35.0k views • 5 months ago
Wes Roth
53.5k views • 6 months ago
Wes Roth
56.7k views • 6 months ago
TheAIGRID
15.6k views • 6 months ago
Wes Roth
59.7k views • 6 months ago
AI For Humans
626 views • 6 months ago
Wes Roth
10.6k views • 6 months ago
Wes Roth
19.1k views • 7 months ago
Wes Roth
53.5k views • 7 months ago
Wes Roth
70.3k views • 7 months ago
Wes Roth
49.0k views • 7 months ago
Wes Roth
21.3k views • 7 months ago
Wes Roth
40.2k views • 7 months ago
Wes Roth
59.4k views • 7 months ago
Wes Roth
55.4k views • 7 months ago
AI Jason
56.1k views • 7 months ago
Wes Roth
25.4k views • 7 months ago
Wes Roth
40.3k views • 7 months ago
Wes Roth
100.8k views • 7 months ago
Wes Roth
90.4k views • 7 months ago
AI Jason
13.0k views • 7 months ago
Wes Roth
67.1k views • 7 months ago
Wes Roth
34.6k views • 7 months ago
Wes Roth
84.7k views • 7 months ago
Wes Roth
42.6k views • 8 months ago
Wes Roth
31.7k views • 8 months ago
Wes Roth
48.3k views • 8 months ago
Wes Roth
43.4k views • 8 months ago
Wes Roth
25.9k views • 8 months ago
Wes Roth
69.4k views • 8 months ago
Wes Roth
46.3k views • 8 months ago
Wes Roth
34.1k views • 8 months ago
Wes Roth
75.3k views • 8 months ago
AI Jason
15.0k views • 8 months ago
AI For Humans
1.8k views • 8 months ago
Andrej Karpathy
686.3k views • 9 months ago
AI Jason
17.6k views • 9 months ago
TheAIGRID
21.0k views • 9 months ago
TheAIGRID
29.2k views • 9 months ago
TheAIGRID
36.3k views • 9 months ago
TheAIGRID
10.5k views • 9 months ago
TheAIGRID
61.1k views • 9 months ago
AI For Humans
5.6k views • 9 months ago
TheAIGRID
14.1k views • 9 months ago
AI Explained
151.7k views • 9 months ago
TheAIGRID
4.9k views • 9 months ago
TheAIGRID
95.1k views • 9 months ago
TheAIGRID
16.8k views • 9 months ago
TheAIGRID
54.5k views • 9 months ago
TheAIGRID
43.5k views • 9 months ago
TheAIGRID
18.7k views • 9 months ago
TheAIGRID
30.1k views • 9 months ago
TheAIGRID
39.1k views • 9 months ago
AI Jason
75.1k views • 9 months ago
TheAIGRID
176.2k views • 9 months ago
TheAIGRID
37.7k views • 9 months ago
TheAIGRID
17.5k views • 9 months ago
TheAIGRID
35.1k views • 9 months ago
AI Explained
388.7k views • 9 months ago
TheAIGRID
71.3k views • 9 months ago
TheAIGRID
55.3k views • 9 months ago
TheAIGRID
6.2k views • 10 months ago
TheAIGRID
27.9k views • 10 months ago
TheAIGRID
14.6k views • 10 months ago
AI For Humans
948 views • 10 months ago
TheAIGRID
20.8k views • 10 months ago
TheAIGRID
25.3k views • 10 months ago
TheAIGRID
36.6k views • 10 months ago
AI Explained
129.2k views • 10 months ago
AI Explained
97.7k views • 10 months ago
AI For Humans
5.7k views • 10 months ago
AI Jason
354.8k views • 10 months ago
AI For Humans
667 views • 10 months ago
AI For Humans
3.5k views • 10 months ago
Morningside AI
13.5k views • 10 months ago
AI For Humans
781 views • 10 months ago
AI Explained
129.9k views • 10 months ago
AI For Humans
1.5k views • 10 months ago
AI Jason
49.4k views • 10 months ago
AI Explained
118.4k views • 11 months ago
AI For Humans
3.0k views • 11 months ago
AI Jason
113.7k views • 11 months ago
AI For Humans
387 views • 11 months ago
AI For Humans
3.6k views • 11 months ago
AI Explained
118.3k views • 11 months ago
AI For Humans
2.3k views • 11 months ago
AI For Humans
1.7k views • 11 months ago
AI Jason
30.7k views • 11 months ago
AI For Humans
339 views • 11 months ago
AI For Humans
2.6k views • 11 months ago
AI Explained
106.4k views • 11 months ago
AI Explained
131.0k views • 11 months ago
AI For Humans
1.5k views • 11 months ago
AI Jason
218.6k views • 1 year ago
AI For Humans
1.4k views • 1 year ago
AI For Humans
1.8k views • 1 year ago
AI Explained
181.1k views • 1 year ago
AI Jason
35.1k views • 1 year ago
AI Explained
151.1k views • 1 year ago
Andrej Karpathy
482.7k views • 1 year ago
AI Explained
241.8k views • 1 year ago
AI Jason
63.7k views • 1 year ago
AI Explained
187.7k views • 1 year ago
AI Explained
161.6k views • 1 year ago
AI Jason
91.0k views • 1 year ago
AI Explained
272.8k views • 1 year ago
AI Jason
61.4k views • 1 year ago
AI Explained
96.8k views • 1 year ago
AI Jason
7.2k views • 1 year ago
AI Explained
145.9k views • 1 year ago
AI Explained
133.4k views • 1 year ago
AI Explained
79.5k views • 1 year ago
AI Jason
16.8k views • 1 year ago
AI Explained
84.1k views • 1 year ago
AI Explained
74.6k views • 1 year ago
AI Explained
144.9k views • 1 year ago
AI Jason
75.2k views • 1 year ago
Morningside AI
4.1k views • 1 year ago
AI Explained
83.7k views • 1 year ago
AI Jason
140.3k views • 1 year ago
AI Jason
33.7k views • 1 year ago
Morningside AI
9.8k views • 1 year ago
AI Explained
229.6k views • 1 year ago
Andrej Karpathy
1.9M views • 1 year ago
AI Explained
112.8k views • 1 year ago
Morningside AI
26.1k views • 1 year ago
AI Jason
16.3k views • 1 year ago
AI Jason
71.9k views • 1 year ago
AI Jason
53.8k views • 1 year ago
AI Jason
20.4k views • 1 year ago
AI Jason
53.4k views • 1 year ago
AI Jason
28.9k views • 1 year ago
Andrej Karpathy
4.3M views • 2 years ago
Andrej Karpathy
157.3k views • 2 years ago
Andrej Karpathy
172.8k views • 2 years ago
Andrej Karpathy
247.8k views • 2 years ago
Andrej Karpathy
278.3k views • 2 years ago
204 Comments
i did it
[pound pound pound]
derives from a mandate from the masses, accompanied by force!
TIM: I warned you! Oh, no, you! But did you knew it all,
LAUNCELOT: Ah. Let     See More
hey andrej, this is where i'm lost. what's the point of linearly scaling down from channel embeddings of 32 to 16 head size? why don't we keep this at 32?
This man really has a gift in teaching stuff. Wish I was good at something but I suck at everything, (mediocrity is killing me). But hey, I completed the video feeling like I understood some     See More
fyi for anyone on macbooks, change device = 'cuda' if if torch.cuda.is_available() else 'cpu' to
device = 'cuda' if torch.cuda.is_available() else 'mps     See More
Thank you - this bring sanity to the space by demonstrating exactly how it works. It's not 'magic'. It's not 'human'. It's code. thank you so much.
I only just noticed that this is set up in a perfect 2 column layout so a person can have the script/notebook they are working on side by side with yours and not have to jump around at all.     See More
On behalf of all humans: Thank you Andrej!     See Less
i did it
[pound pound pound]
derives from a mandate from the masses, accompanied by force!
TIM: I warned you! Oh, no, you! But did you knew it all,
LAUNCELOT: Ah. Let     See More ssing me in my liege.
W I warned you listen to beat us. Come on then.
[chord]
LEFT HEAD: Oh, Concorde!
DINGO: In the name of Assyria?
BEDEMIR: Yes, yes, remove the supports!
DENNIS: Witch!
HERBERT: Man!
CROWD: Burn her!    See Less
Come on Andrej!!! I can hardly wait for the next video! We love you man     See Less
This is a fantastically clear explanation, thank you so much!     See Less
You are impressively efficient. This was a blast to watch     See Less
hey andrej, this is where i'm lost. what's the point of linearly scaling down from channel embeddings of 32 to 16 head size? why don't we keep this at 32?     See Less
This man really has a gift in teaching stuff. Wish I was good at something but I suck at everything, (mediocrity is killing me). But hey, I completed the video feeling like I understood some     See More t's nice. Thank you Andrej    See Less
fyi for anyone on macbooks, change device = 'cuda' if if torch.cuda.is_available() else 'cpu' to
device = 'cuda' if torch.cuda.is_available() else 'mps     See More h.backends.mps.is_available() else 'cpu'
anyone else can make this change too, just makes it so the device checks for m1 gpu availability too before it reverts to cpu    See Less
Thank you - this bring sanity to the space by demonstrating exactly how it works. It's not 'magic'. It's not 'human'. It's code. thank you so much.     See Less
I only just noticed that this is set up in a perfect 2 column layout so a person can have the script/notebook they are working on side by side with yours and not have to jump around at all.     See More ;s clean and clutter free. That is some classy action, my deepest respect and gratitude.    See Less