Do you speed up your video before uploading? It sounds like x1.5 on normal speed.
Andrej Karpathy
1.3M subscribersThe Tokenizer is a necessary and pervasive component of Large Language Models (LLMs), where it translates between strings ...
Do you speed up your video before uploading? It sounds like...
356 Comments
15:00
TheAIGRID
11.9k views • 2 months ago
20:52
Wes Roth
55.6k views • 2 months ago
15:57
TheAIGRID
15.3k views • 2 months ago
27:28
Wes Roth
109.4k views • 2 months ago
22:12
TheAIGRID
10.8k views • 2 months ago
19:53
TheAIGRID
12.3k views • 2 months ago
21:52
AI Explained
78.4k views • 2 months ago
58:29
AI For Humans
9.7k views • 2 months ago
23:50
TheAIGRID
16.8k views • 2 months ago
13:15
Wes Roth
52.6k views • 2 months ago
Shelf will be hidden for 30 daysUndo
15:17
AI Jason
27.9k views • 2 months ago
16:40
Wes Roth
46.8k views • 2 months ago
11:33
TheAIGRID
7.7k views • 2 months ago
39:39
Wes Roth
39.2k views • 2 months ago
01:03
AI For Humans
2.2k views • 2 months ago
14:10
TheAIGRID
21.9k views • 2 months ago
19:31
TheAIGRID
10.1k views • 2 months ago
23:53
Wes Roth
35.1k views • 2 months ago
16:39
TheAIGRID
23.0k views • 2 months ago
29:32
TheAIGRID
11.0k views • 2 months ago
12:34
TheAIGRID
10.4k views • 2 months ago
13:00
TheAIGRID
7.6k views • 2 months ago
13:40
AI Explained
40.1k views • 2 months ago
58:08
AI For Humans
9.0k views • 2 months ago
16:26
TheAIGRID
10.7k views • 2 months ago
32:43
TheAIGRID
24.0k views • 2 months ago
04:53
AI Jason
20.6k views • 2 months ago
32:27
Wes Roth
56.0k views • 2 months ago
07:00
TheAIGRID
3.0k views • 2 months ago
24:44
Wes Roth
78.9k views • 2 months ago
96:00
Wes Roth
44.3k views • 2 months ago
19:59
TheAIGRID
13.9k views • 2 months ago
14:10
AI Jason
183.5k views • 2 months ago
13:09
TheAIGRID
4.7k views • 2 months ago
21:55
TheAIGRID
15.3k views • 2 months ago
17:29
Wes Roth
16.9k views • 2 months ago
18:50
AI Explained
105.5k views • 2 months ago
52:21
AI For Humans
14.0k views • 2 months ago
12:43
TheAIGRID
30.9k views • 2 months ago
10:58
Wes Roth
48.8k views • 2 months ago
21:15
TheAIGRID
20.0k views • 2 months ago
15:28
AI Jason
38.4k views • 2 months ago
10:15
TheAIGRID
12.2k views • 2 months ago
18:06
TheAIGRID
19.7k views • 2 months ago
02:30
AI For Humans
5.3k views • 2 months ago
10:32
TheAIGRID
9.2k views • 2 months ago
11:24
AI Jason
52.5k views • 2 months ago
12:54
Wes Roth
33.2k views • 2 months ago
01:50
AI For Humans
5.0k views • 2 months ago
26:19
Wes Roth
102.1k views • 3 months ago
22:33
TheAIGRID
57.9k views • 3 months ago
62:43
AI For Humans
28.1k views • 3 months ago
23:07
TheAIGRID
12.5k views • 3 months ago
10:31
Wes Roth
39.2k views • 3 months ago
50:36
Wes Roth
75.8k views • 3 months ago
43:03
TheAIGRID
59.8k views • 3 months ago
08:06
TheAIGRID
43.1k views • 3 months ago
21:07
TheAIGRID
28.9k views • 3 months ago
22:15
TheAIGRID
53.8k views • 3 months ago
18:32
TheAIGRID
25.1k views • 3 months ago
15:29
Wes Roth
68.2k views • 3 months ago
12:35
TheAIGRID
14.8k views • 3 months ago
09:57
TheAIGRID
12.8k views • 3 months ago
09:39
AI Jason
25.2k views • 3 months ago
10:07
TheAIGRID
13.8k views • 3 months ago
19:50
AI Explained
79.3k views • 3 months ago
10:57
TheAIGRID
7.5k views • 3 months ago
57:15
AI For Humans
11.2k views • 3 months ago
10:30
Wes Roth
20.1k views • 3 months ago
15:44
Wes Roth
46.1k views • 3 months ago
05:25
TheAIGRID
623 views • 3 months ago
10:03
Wes Roth
57.4k views • 3 months ago
01:35
AI For Humans
2.5k views • 3 months ago
10:55
TheAIGRID
9.5k views • 3 months ago
12:49
TheAIGRID
11.1k views • 3 months ago
10:47
Wes Roth
92.3k views • 3 months ago
10:12
TheAIGRID
12.5k views • 3 months ago
01:47
AI For Humans
1.2k views • 3 months ago
05:19
TheAIGRID
4.0k views • 3 months ago
31:51
Wes Roth
80.7k views • 3 months ago
08:50
TheAIGRID
41.5k views • 3 months ago
08:05
TheAIGRID
3.4k views • 3 months ago
32:40
Wes Roth
78.3k views • 3 months ago
13:22
TheAIGRID
23.6k views • 3 months ago
13:22
TheAIGRID
2.3k views • 3 months ago
01:44
AI For Humans
1.2k views • 3 months ago
11:31
TheAIGRID
10.9k views • 3 months ago
10:00
TheAIGRID
44.1k views • 3 months ago
25:00
Wes Roth
121.8k views • 3 months ago
11:46
TheAIGRID
23.0k views • 3 months ago
01:22
AI For Humans
21.6k views • 3 months ago
11:25
TheAIGRID
7.2k views • 3 months ago
53:42
AI For Humans
12.0k views • 3 months ago
23:17
Wes Roth
35.0k views • 3 months ago
08:02
TheAIGRID
9.4k views • 3 months ago
17:30
Wes Roth
34.3k views • 3 months ago
22:13
AI Explained
69.4k views • 3 months ago
23:08
Wes Roth
36.2k views • 3 months ago
23:08
Wes Roth
41 views • 3 months ago
09:19
TheAIGRID
7.6k views • 3 months ago
11:31
TheAIGRID
13.4k views • 3 months ago
27:09
Wes Roth
77.7k views • 3 months ago
10:51
AI Jason
18.6k views • 3 months ago
09:46
TheAIGRID
21.1k views • 3 months ago
08:19
TheAIGRID
4.3k views • 3 months ago
59:16
AI For Humans
11.7k views • 3 months ago
09:27
TheAIGRID
19.4k views • 3 months ago
11:05
TheAIGRID
4.4k views • 3 months ago
09:31
TheAIGRID
13.7k views • 3 months ago
08:10
TheAIGRID
8.9k views • 3 months ago
01:20
AI For Humans
2.8k views • 3 months ago
12:56
TheAIGRID
6.8k views • 3 months ago
55:25
AI For Humans
12.3k views • 3 months ago
19:03
AI Explained
104.1k views • 4 months ago
18:16
TheAIGRID
19.3k views • 4 months ago
13:18
TheAIGRID
21.4k views • 4 months ago
01:56
AI For Humans
8.6k views • 4 months ago
41:56
AI For Humans
11.1k views • 4 months ago
02:31
AI For Humans
2.0k views • 4 months ago
15:52
TheAIGRID
49.7k views • 4 months ago
10:25
TheAIGRID
448.8k views • 4 months ago
18:54
AI Jason
73.4k views • 4 months ago
33:27
AI Explained
123.6k views • 4 months ago
09:34
TheAIGRID
18.8k views • 4 months ago
20:00
AI Explained
89.8k views • 4 months ago
45:20
AI For Humans
9.6k views • 4 months ago
25:37
TheAIGRID
42.4k views • 4 months ago
35:11
TheAIGRID
23.1k views • 4 months ago
10:39
TheAIGRID
56.1k views • 4 months ago
13:03
TheAIGRID
15.1k views • 5 months ago
17:42
AI Explained
89.4k views • 5 months ago
55:07
AI For Humans
11.5k views • 5 months ago
11:29
AI Jason
96.4k views • 5 months ago
41:56
TheAIGRID
26.6k views • 5 months ago
33:44
TheAIGRID
9.4k views • 5 months ago
10:12
TheAIGRID
20.4k views • 5 months ago
20:16
AI Explained
74.9k views • 5 months ago
49:17
AI For Humans
10.7k views • 5 months ago
11:29
TheAIGRID
6.3k views • 5 months ago
13:46
TheAIGRID
25.8k views • 5 months ago
10:43
TheAIGRID
7.1k views • 5 months ago
00:26
AI For Humans
3.6k views • 5 months ago
02:17
TheAIGRID
6.1k views • 5 months ago
12:33
AI Jason
31.3k views • 5 months ago
00:42
AI For Humans
5.4k views • 5 months ago
44:40
AI For Humans
15.8k views • 5 months ago
14:56
AI Explained
60.4k views • 5 months ago
01:41
AI For Humans
6.0k views • 5 months ago
21:43
AI Explained
118.6k views • 5 months ago
23:40
TheAIGRID
71.5k views • 5 months ago
13:33
TheAIGRID
8.8k views • 5 months ago
14:40
TheAIGRID
27.0k views • 5 months ago
15:37
TheAIGRID
113.8k views • 5 months ago
15:07
TheAIGRID
17.6k views • 5 months ago
18:27
AI Explained
61.9k views • 6 months ago
45:12
AI For Humans
12.1k views • 6 months ago
12:54
AI Explained
60.7k views • 6 months ago
55:23
AI For Humans
13.1k views • 6 months ago
08:33
AI Jason
41.4k views • 6 months ago
14:14
AI Explained
58.4k views • 6 months ago
05:14
AI Jason
33.6k views • 6 months ago
11:47
AI Jason
61.4k views • 7 months ago
15:44
AI Explained
58.8k views • 7 months ago
14:07
AI Explained
67.5k views • 7 months ago
11:32
AI Explained
20.2k views • 7 months ago
11:32
AI Explained
48.7k views • 7 months ago
06:41
AI Jason
18.0k views • 8 months ago
18:55
AI Explained
57.9k views • 8 months ago
16:02
AI Jason
116.1k views • 9 months ago
15:02
AI Explained
163.6k views • 9 months ago
11:55
AI Explained
199.3k views • 9 months ago
18:44
AI Jason
139.2k views • 9 months ago
17:20
AI Explained
84.7k views • 9 months ago
07:02
AI Jason
81.7k views • 10 months ago
11:44
AI Explained
179.1k views • 10 months ago
09:29
AI Jason
53.2k views • 10 months ago
16:39
AI Jason
188.3k views • 10 months ago
26:20
AI Explained
110.5k views • 10 months ago
05:56
AI Jason
23.0k views • 10 months ago
14:01
AI Explained
101.8k views • 11 months ago
22:02
AI Jason
18.2k views • 11 months ago
16:50
AI Explained
96.4k views • 11 months ago
03:35
AI Jason
52.7k views • 11 months ago
19:05
AI Explained
99.1k views • 11 months ago
04:25
AI Jason
24.5k views • 11 months ago
14:02
AI Jason
10.2k views • 11 months ago
11:44
AI Jason
35.5k views • 1 year ago
131:12
Andrej Karpathy
2.3M views • 1 year ago
211:24
Andrej Karpathy
5.8M views • 1 year ago
81:55
Andrej Karpathy
34.7k views • 1 year ago
241:26
Andrej Karpathy
1.0M views • 1 year ago
30:38
Morningside AI
13.8k views • 2 years ago
133:35
Andrej Karpathy
1.0M views • 2 years ago
26:56
Morningside AI
4.2k views • 2 years ago
45:54
Morningside AI
10.1k views • 2 years ago
59:48
Andrej Karpathy
3.5M views • 2 years ago
39:00
Morningside AI
26.7k views • 2 years ago
116:20
Andrej Karpathy
6.9M views • 3 years ago
56:22
Andrej Karpathy
264.4k views • 3 years ago
115:24
Andrej Karpathy
328.8k views • 3 years ago
115:58
Andrej Karpathy
475.4k views • 3 years ago
75:40
Andrej Karpathy
510.0k views • 3 years ago
356 Comments
Do you speed up your video before uploading? It sounds like x1.5 on normal speed.
I have been follwing you channel for more than 1 year and man you create state of art DL videos hope we see you more on new topics like mamba
Very well done!
Some questions I am walking away pondering:
- Totally understandable why it’s not feasible to train an LLM on a byte stream and why we tokenize. Although I gu     See More
So, if you get to the Taylor Swift part, you probably going to go all the way to the end of the video?
Hello Andrei, the new era of AI has agitated me. With fast growing AI technology i dont even know if i should learn how to coding, programming now . Cause there a many no code tools b     See More
I was on interview few months back and the interviewer wanted me to implement this in 15 minutes. I failed at that time, not I would rock. Thanks for that.
Do you speed up your video before uploading? It sounds like x1.5 on normal speed.     See Less
Can we extend the tokens adding new languages and fine tune the exiating model?     See Less
I have been follwing you channel for more than 1 year and man you create state of art DL videos hope we see you more on new topics like mamba     See Less
Very well done!
Some questions I am walking away pondering:
- Totally understandable why it’s not feasible to train an LLM on a byte stream and why we tokenize. Although I gu     See More wondering, let’s say we had the compute to do that. Are we losing too much semantic value that way? I get that probably would manifest the same on the other side but… I don’t know. Maybe I just need to think about it some more. It feels sort of like a Star Trek teleporter thing, where the person is sort of “vaporized” and then “reassembled” on the other side. 😂
- I guess, what is your general take on the intuition for SentencePiece? Sort of in alignment with my point above, are all those knobs and dials seeking the preserve that “semantic state”?
I think I’m answering the questions in my head as I type here. 😂 This is a new topic for me, and I’ve found it genuinely a lot of fun to think about. Thank you again for your work!    See Less
So, if you get to the Taylor Swift part, you probably going to go all the way to the end of the video?     See Less
Hello Andrei, the new era of AI has agitated me. With fast growing AI technology i dont even know if i should learn how to coding, programming now . Cause there a many no code tools b     See More oping right now. Im sure that my job will be among the first to be replaced by AI . What advice you can give a 27 yers old man who strive to change his carrer . But i dont know which direction i can pursue or what trend to follow?    See Less
Such an amazing video!     See Less
The last 20 secs is the best lol     See Less
Thank you!     See Less
I was on interview few months back and the interviewer wanted me to implement this in 15 minutes. I failed at that time, not I would rock. Thanks for that.     See Less