On behalf of all humans: Thank you Andrej!
Andrej Karpathy
446K subscribersWe build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 ...
I only just noticed that this is set up in a perfect 2 colum...
170 Comments
Wes Roth
4.7k views • 9 hours ago
TheAIGRID
11.2k views • 18 hours ago
TheAIGRID
31.4k views • 1 day ago
Wes Roth
39.6k views • 1 day ago
TheAIGRID
22.7k views • 3 days ago
Wes Roth
51.0k views • 4 days ago
TheAIGRID
26.5k views • 4 days ago
TheAIGRID
9.2k views • 4 days ago
TheAIGRID
35.6k views • 6 days ago
Wes Roth
62.8k views • 6 days ago
Shelf will be hidden for 30 daysUndo
TheAIGRID
45.1k views • 6 days ago
Wes Roth
27.1k views • 1 week ago
Wes Roth
55.4k views • 1 week ago
AI Jason
81.4k views • 1 week ago
TheAIGRID
36.6k views • 1 week ago
TheAIGRID
6.3k views • 1 week ago
TheAIGRID
19.6k views • 1 week ago
TheAIGRID
13.6k views • 1 week ago
Wes Roth
51.9k views • 1 week ago
AI For Humans
598 views • 1 week ago
Wes Roth
60.9k views • 1 week ago
TheAIGRID
147.6k views • 1 week ago
TheAIGRID
42.4k views • 1 week ago
AI For Humans
3.0k views • 1 week ago
TheAIGRID
30.8k views • 2 weeks ago
Wes Roth
48.9k views • 2 weeks ago
Wes Roth
39.1k views • 2 weeks ago
TheAIGRID
32.0k views • 2 weeks ago
Wes Roth
59.6k views • 2 weeks ago
TheAIGRID
33.5k views • 2 weeks ago
TheAIGRID
85.7k views • 2 weeks ago
Wes Roth
92.3k views • 2 weeks ago
Morningside AI
8.0k views • 2 weeks ago
Wes Roth
139.6k views • 2 weeks ago
AI For Humans
763 views • 2 weeks ago
TheAIGRID
28.6k views • 2 weeks ago
Wes Roth
33.4k views • 2 weeks ago
AI Explained
123.1k views • 2 weeks ago
TheAIGRID
457.7k views • 2 weeks ago
AI For Humans
1.4k views • 2 weeks ago
TheAIGRID
21.7k views • 3 weeks ago
Wes Roth
28.5k views • 3 weeks ago
Wes Roth
48.6k views • 3 weeks ago
TheAIGRID
398.9k views • 3 weeks ago
Wes Roth
19.7k views • 3 weeks ago
TheAIGRID
31.3k views • 3 weeks ago
AI Jason
38.3k views • 3 weeks ago
Wes Roth
60.8k views • 3 weeks ago
Wes Roth
20.6k views • 3 weeks ago
TheAIGRID
18.1k views • 3 weeks ago
TheAIGRID
53.2k views • 3 weeks ago
Wes Roth
46.5k views • 3 weeks ago
Wes Roth
33.5k views • 3 weeks ago
Wes Roth
83.3k views • 3 weeks ago
Wes Roth
35.4k views • 3 weeks ago
TheAIGRID
40.1k views • 3 weeks ago
Wes Roth
37.4k views • 3 weeks ago
Wes Roth
16.2k views • 3 weeks ago
TheAIGRID
26.4k views • 3 weeks ago
AI Explained
115.9k views • 3 weeks ago
AI For Humans
2.9k views • 3 weeks ago
TheAIGRID
41.8k views • 4 weeks ago
TheAIGRID
40.3k views • 4 weeks ago
AI Jason
68.2k views • 1 month ago
TheAIGRID
40.6k views • 1 month ago
AI For Humans
373 views • 1 month ago
TheAIGRID
51.3k views • 1 month ago
TheAIGRID
19.7k views • 1 month ago
TheAIGRID
31.6k views • 1 month ago
TheAIGRID
103.6k views • 1 month ago
AI For Humans
3.5k views • 1 month ago
TheAIGRID
45.8k views • 1 month ago
TheAIGRID
56.0k views • 1 month ago
AI Explained
115.3k views • 1 month ago
AI For Humans
2.3k views • 1 month ago
AI For Humans
1.7k views • 1 month ago
AI Jason
27.4k views • 1 month ago
AI For Humans
334 views • 1 month ago
AI For Humans
2.6k views • 1 month ago
AI Explained
105.5k views • 1 month ago
AI Explained
130.2k views • 1 month ago
AI For Humans
1.5k views • 1 month ago
AI Jason
203.2k views • 1 month ago
AI For Humans
1.4k views • 1 month ago
AI Explained
177.3k views • 2 months ago
AI Jason
33.0k views • 2 months ago
AI Explained
150.6k views • 2 months ago
Andrej Karpathy
453.8k views • 2 months ago
AI Explained
240.7k views • 2 months ago
AI Jason
62.2k views • 2 months ago
AI Explained
187.2k views • 2 months ago
AI Explained
160.9k views • 3 months ago
AI Jason
87.8k views • 3 months ago
AI Explained
270.8k views • 3 months ago
AI Jason
60.7k views • 3 months ago
AI Explained
96.5k views • 3 months ago
AI Jason
7.1k views • 3 months ago
AI Explained
145.7k views • 3 months ago
AI Explained
133.0k views • 4 months ago
AI Explained
79.4k views • 4 months ago
AI Jason
16.2k views • 4 months ago
AI Explained
84.0k views • 4 months ago
AI Explained
74.5k views • 4 months ago
AI Explained
144.7k views • 5 months ago
AI Jason
68.7k views • 5 months ago
Morningside AI
4.1k views • 5 months ago
AI Explained
83.7k views • 5 months ago
AI Jason
134.4k views • 5 months ago
AI Jason
33.3k views • 5 months ago
Morningside AI
9.7k views • 5 months ago
AI Explained
229.0k views • 5 months ago
Andrej Karpathy
1.8M views • 5 months ago
AI Explained
112.8k views • 5 months ago
AI Explained
167.2k views • 5 months ago
AI Explained
156.8k views • 5 months ago
Morningside AI
26.0k views • 5 months ago
AI Jason
16.1k views • 6 months ago
AI Explained
96.4k views • 6 months ago
AI Jason
68.8k views • 6 months ago
AI Explained
120.6k views • 6 months ago
AI Jason
52.6k views • 6 months ago
AI Jason
19.1k views • 7 months ago
AI Jason
52.7k views • 7 months ago
AI Jason
28.6k views • 7 months ago
AI Jason
13.6k views • 7 months ago
AI Jason
183.6k views • 8 months ago
AI Jason
48.3k views • 8 months ago
AI Jason
26.5k views • 8 months ago
AI Jason
14.4k views • 8 months ago
Andrej Karpathy
4.2M views • 1 year ago
Andrej Karpathy
153.6k views • 1 year ago
Andrej Karpathy
167.4k views • 1 year ago
Andrej Karpathy
240.3k views • 1 year ago
Andrej Karpathy
269.9k views • 1 year ago
170 Comments
i did it
[pound pound pound]
derives from a mandate from the masses, accompanied by force!
TIM: I warned you! Oh, no, you! But did you knew it all,
LAUNCELOT: Ah. Let     See More
hey andrej, this is where i'm lost. what's the point of linearly scaling down from channel embeddings of 32 to 16 head size? why don't we keep this at 32?
This man really has a gift in teaching stuff. Wish I was good at something but I suck at everything, (mediocrity is killing me). But hey, I completed the video feeling like I understood some     See More
fyi for anyone on macbooks, change device = 'cuda' if if torch.cuda.is_available() else 'cpu' to
device = 'cuda' if torch.cuda.is_available() else 'mps     See More
Thank you - this bring sanity to the space by demonstrating exactly how it works. It's not 'magic'. It's not 'human'. It's code. thank you so much.
I only just noticed that this is set up in a perfect 2 column layout so a person can have the script/notebook they are working on side by side with yours and not have to jump around at all.     See More
On behalf of all humans: Thank you Andrej!     See Less
i did it
[pound pound pound]
derives from a mandate from the masses, accompanied by force!
TIM: I warned you! Oh, no, you! But did you knew it all,
LAUNCELOT: Ah. Let     See More ssing me in my liege.
W I warned you listen to beat us. Come on then.
[chord]
LEFT HEAD: Oh, Concorde!
DINGO: In the name of Assyria?
BEDEMIR: Yes, yes, remove the supports!
DENNIS: Witch!
HERBERT: Man!
CROWD: Burn her!    See Less
Come on Andrej!!! I can hardly wait for the next video! We love you man     See Less
This is a fantastically clear explanation, thank you so much!     See Less
You are impressively efficient. This was a blast to watch     See Less
hey andrej, this is where i'm lost. what's the point of linearly scaling down from channel embeddings of 32 to 16 head size? why don't we keep this at 32?     See Less
This man really has a gift in teaching stuff. Wish I was good at something but I suck at everything, (mediocrity is killing me). But hey, I completed the video feeling like I understood some     See More t's nice. Thank you Andrej    See Less
fyi for anyone on macbooks, change device = 'cuda' if if torch.cuda.is_available() else 'cpu' to
device = 'cuda' if torch.cuda.is_available() else 'mps     See More h.backends.mps.is_available() else 'cpu'
anyone else can make this change too, just makes it so the device checks for m1 gpu availability too before it reverts to cpu    See Less
Thank you - this bring sanity to the space by demonstrating exactly how it works. It's not 'magic'. It's not 'human'. It's code. thank you so much.     See Less
I only just noticed that this is set up in a perfect 2 column layout so a person can have the script/notebook they are working on side by side with yours and not have to jump around at all.     See More ;s clean and clutter free. That is some classy action, my deepest respect and gratitude.    See Less