Do you speed up your video before uploading? It sounds like x1.5 on normal speed.
Andrej Karpathy
1.3M subscribersThe Tokenizer is a necessary and pervasive component of Large Language Models (LLMs), where it translates between strings ...
Do you speed up your video before uploading? It sounds like...
350 Comments
29:32
TheAIGRID
6.7k views • 17 hours ago
12:34
TheAIGRID
8.4k views • 1 day ago
18:31
Wes Roth
36.0k views • 1 day ago
13:00
TheAIGRID
7.2k views • 1 day ago
13:40
AI Explained
32.2k views • 1 day ago
16:26
TheAIGRID
10.2k views • 2 days ago
20:55
Wes Roth
75.6k views • 3 days ago
32:43
TheAIGRID
20.0k views • 3 days ago
04:53
AI Jason
17.0k views • 4 days ago
32:27
Wes Roth
54.4k views • 4 days ago
Shelf will be hidden for 30 daysUndo
07:00
TheAIGRID
3.0k views • 4 days ago
24:44
Wes Roth
75.0k views • 5 days ago
96:00
Wes Roth
39.8k views • 6 days ago
19:59
TheAIGRID
13.9k views • 6 days ago
14:10
AI Jason
162.9k views • 1 week ago
13:09
TheAIGRID
4.7k views • 1 week ago
21:55
TheAIGRID
15.3k views • 1 week ago
17:29
Wes Roth
16.3k views • 1 week ago
18:50
AI Explained
102.2k views • 1 week ago
52:21
AI For Humans
14.0k views • 1 week ago
12:43
TheAIGRID
30.9k views • 1 week ago
10:58
Wes Roth
48.5k views • 1 week ago
21:15
TheAIGRID
20.0k views • 1 week ago
15:28
AI Jason
34.2k views • 1 week ago
10:15
TheAIGRID
12.2k views • 1 week ago
18:06
TheAIGRID
19.7k views • 1 week ago
02:30
AI For Humans
5.0k views • 1 week ago
10:32
TheAIGRID
9.2k views • 1 week ago
11:24
AI Jason
48.5k views • 2 weeks ago
12:54
Wes Roth
33.0k views • 2 weeks ago
01:50
AI For Humans
4.5k views • 2 weeks ago
26:19
Wes Roth
101.8k views • 2 weeks ago
22:33
TheAIGRID
57.9k views • 2 weeks ago
62:43
AI For Humans
26.9k views • 2 weeks ago
23:07
TheAIGRID
12.5k views • 2 weeks ago
10:31
Wes Roth
38.9k views • 2 weeks ago
50:36
Wes Roth
71.6k views • 2 weeks ago
43:03
TheAIGRID
59.8k views • 2 weeks ago
08:06
TheAIGRID
43.1k views • 2 weeks ago
21:07
TheAIGRID
28.9k views • 2 weeks ago
22:15
TheAIGRID
53.8k views • 2 weeks ago
18:32
TheAIGRID
25.1k views • 2 weeks ago
15:29
Wes Roth
67.9k views • 2 weeks ago
12:35
TheAIGRID
14.8k views • 3 weeks ago
09:57
TheAIGRID
12.8k views • 3 weeks ago
09:39
AI Jason
23.2k views • 3 weeks ago
10:07
TheAIGRID
13.8k views • 3 weeks ago
19:50
AI Explained
78.7k views • 3 weeks ago
10:57
TheAIGRID
7.5k views • 3 weeks ago
57:15
AI For Humans
10.8k views • 3 weeks ago
10:30
Wes Roth
20.0k views • 3 weeks ago
15:44
Wes Roth
45.7k views • 3 weeks ago
05:25
TheAIGRID
623 views • 3 weeks ago
10:03
Wes Roth
57.4k views • 3 weeks ago
01:35
AI For Humans
2.4k views • 3 weeks ago
10:55
TheAIGRID
9.5k views • 3 weeks ago
12:49
TheAIGRID
11.1k views • 3 weeks ago
10:47
Wes Roth
92.2k views • 3 weeks ago
10:12
TheAIGRID
12.5k views • 3 weeks ago
01:47
AI For Humans
1.2k views • 3 weeks ago
05:19
TheAIGRID
4.0k views • 3 weeks ago
31:51
Wes Roth
80.1k views • 3 weeks ago
08:50
TheAIGRID
41.5k views • 3 weeks ago
08:05
TheAIGRID
3.4k views • 3 weeks ago
32:40
Wes Roth
78.2k views • 3 weeks ago
13:22
TheAIGRID
23.6k views • 3 weeks ago
13:22
TheAIGRID
2.3k views • 3 weeks ago
01:44
AI For Humans
1.2k views • 3 weeks ago
11:31
TheAIGRID
10.9k views • 3 weeks ago
10:00
TheAIGRID
44.1k views • 3 weeks ago
25:00
Wes Roth
121.6k views • 1 month ago
11:46
TheAIGRID
23.0k views • 1 month ago
01:22
AI For Humans
20.7k views • 4 weeks ago
11:25
TheAIGRID
7.2k views • 4 weeks ago
53:42
AI For Humans
11.8k views • 4 weeks ago
23:17
Wes Roth
34.9k views • 4 weeks ago
08:02
TheAIGRID
9.4k views • 4 weeks ago
17:30
Wes Roth
34.2k views • 1 month ago
22:13
AI Explained
68.9k views • 1 month ago
23:08
Wes Roth
36.1k views • 1 month ago
23:08
Wes Roth
41 views • 1 month ago
09:19
TheAIGRID
7.6k views • 1 month ago
11:31
TheAIGRID
13.4k views • 1 month ago
27:09
Wes Roth
77.6k views • 1 month ago
12:43
Wes Roth
28.4k views • 1 month ago
10:51
AI Jason
18.0k views • 1 month ago
09:46
TheAIGRID
21.1k views • 1 month ago
35:11
Wes Roth
36.6k views • 1 month ago
08:19
TheAIGRID
4.3k views • 1 month ago
59:16
AI For Humans
11.5k views • 1 month ago
09:27
TheAIGRID
19.4k views • 1 month ago
11:05
TheAIGRID
4.4k views • 1 month ago
09:31
TheAIGRID
13.7k views • 1 month ago
08:10
TheAIGRID
8.9k views • 1 month ago
01:20
AI For Humans
2.8k views • 1 month ago
12:56
TheAIGRID
6.8k views • 1 month ago
55:25
AI For Humans
12.2k views • 1 month ago
19:03
AI Explained
103.4k views • 1 month ago
18:16
TheAIGRID
19.3k views • 1 month ago
13:18
TheAIGRID
21.4k views • 1 month ago
01:56
AI For Humans
8.6k views • 1 month ago
41:56
AI For Humans
11.0k views • 1 month ago
02:31
AI For Humans
2.0k views • 1 month ago
15:52
TheAIGRID
49.7k views • 1 month ago
10:25
TheAIGRID
448.8k views • 2 months ago
18:54
AI Jason
73.0k views • 2 months ago
33:27
AI Explained
123.3k views • 2 months ago
09:34
TheAIGRID
18.8k views • 2 months ago
20:00
AI Explained
89.7k views • 2 months ago
45:20
AI For Humans
9.4k views • 2 months ago
25:37
TheAIGRID
42.4k views • 2 months ago
35:11
TheAIGRID
23.1k views • 2 months ago
10:39
TheAIGRID
56.1k views • 2 months ago
13:03
TheAIGRID
15.1k views • 2 months ago
17:42
AI Explained
89.4k views • 2 months ago
55:07
AI For Humans
11.4k views • 2 months ago
11:29
AI Jason
95.0k views • 2 months ago
41:56
TheAIGRID
26.6k views • 2 months ago
33:44
TheAIGRID
9.4k views • 2 months ago
10:12
TheAIGRID
20.4k views • 2 months ago
20:16
AI Explained
74.8k views • 2 months ago
49:17
AI For Humans
10.6k views • 2 months ago
11:29
TheAIGRID
6.3k views • 2 months ago
13:46
TheAIGRID
25.8k views • 3 months ago
10:43
TheAIGRID
7.1k views • 2 months ago
00:26
AI For Humans
3.6k views • 3 months ago
02:17
TheAIGRID
6.1k views • 3 months ago
12:33
AI Jason
31.2k views • 3 months ago
00:42
AI For Humans
5.4k views • 3 months ago
44:40
AI For Humans
15.8k views • 3 months ago
14:56
AI Explained
60.4k views • 3 months ago
01:41
AI For Humans
6.0k views • 3 months ago
21:43
AI Explained
118.5k views • 3 months ago
23:40
TheAIGRID
71.5k views • 3 months ago
13:33
TheAIGRID
8.8k views • 3 months ago
14:40
TheAIGRID
27.0k views • 3 months ago
15:37
TheAIGRID
113.8k views • 3 months ago
15:07
TheAIGRID
17.6k views • 3 months ago
18:27
AI Explained
61.9k views • 3 months ago
45:12
AI For Humans
12.1k views • 3 months ago
12:54
AI Explained
60.7k views • 3 months ago
55:23
AI For Humans
13.1k views • 3 months ago
08:33
AI Jason
41.2k views • 3 months ago
14:14
AI Explained
58.4k views • 4 months ago
05:14
AI Jason
33.5k views • 4 months ago
11:47
AI Jason
61.0k views • 4 months ago
15:44
AI Explained
58.8k views • 4 months ago
14:07
AI Explained
67.5k views • 5 months ago
11:32
AI Explained
20.2k views • 5 months ago
11:32
AI Explained
48.7k views • 5 months ago
06:41
AI Jason
17.9k views • 5 months ago
18:55
AI Explained
57.9k views • 6 months ago
16:02
AI Jason
115.1k views • 6 months ago
15:02
AI Explained
163.6k views • 6 months ago
11:55
AI Explained
199.3k views • 6 months ago
18:44
AI Jason
138.9k views • 7 months ago
17:20
AI Explained
84.7k views • 7 months ago
07:02
AI Jason
81.7k views • 7 months ago
11:44
AI Explained
179.1k views • 7 months ago
09:29
AI Jason
53.2k views • 7 months ago
16:39
AI Jason
188.0k views • 8 months ago
26:20
AI Explained
110.5k views • 8 months ago
05:56
AI Jason
23.0k views • 8 months ago
14:01
AI Explained
101.8k views • 8 months ago
22:02
AI Jason
18.2k views • 8 months ago
16:50
AI Explained
96.4k views • 8 months ago
03:35
AI Jason
52.6k views • 9 months ago
19:05
AI Explained
99.1k views • 9 months ago
04:25
AI Jason
24.5k views • 9 months ago
14:02
AI Jason
10.2k views • 9 months ago
11:44
AI Jason
35.5k views • 9 months ago
19:04
AI Jason
55.2k views • 10 months ago
131:12
Andrej Karpathy
2.3M views • 1 year ago
211:24
Andrej Karpathy
5.7M views • 1 year ago
81:55
Andrej Karpathy
34.7k views • 1 year ago
241:26
Andrej Karpathy
1.0M views • 1 year ago
30:38
Morningside AI
13.8k views • 1 year ago
133:35
Andrej Karpathy
1.0M views • 2 years ago
26:56
Morningside AI
4.2k views • 2 years ago
45:54
Morningside AI
10.1k views • 2 years ago
59:48
Andrej Karpathy
3.4M views • 2 years ago
39:00
Morningside AI
26.7k views • 2 years ago
116:20
Andrej Karpathy
6.9M views • 3 years ago
56:22
Andrej Karpathy
263.0k views • 3 years ago
115:24
Andrej Karpathy
326.7k views • 3 years ago
115:58
Andrej Karpathy
475.4k views • 3 years ago
75:40
Andrej Karpathy
510.0k views • 3 years ago
350 Comments
Do you speed up your video before uploading? It sounds like x1.5 on normal speed.
I have been follwing you channel for more than 1 year and man you create state of art DL videos hope we see you more on new topics like mamba
Very well done!
Some questions I am walking away pondering:
- Totally understandable why it’s not feasible to train an LLM on a byte stream and why we tokenize. Although I gu     See More
So, if you get to the Taylor Swift part, you probably going to go all the way to the end of the video?
Hello Andrei, the new era of AI has agitated me. With fast growing AI technology i dont even know if i should learn how to coding, programming now . Cause there a many no code tools b     See More
I was on interview few months back and the interviewer wanted me to implement this in 15 minutes. I failed at that time, not I would rock. Thanks for that.
Do you speed up your video before uploading? It sounds like x1.5 on normal speed.     See Less
Can we extend the tokens adding new languages and fine tune the exiating model?     See Less
I have been follwing you channel for more than 1 year and man you create state of art DL videos hope we see you more on new topics like mamba     See Less
Very well done!
Some questions I am walking away pondering:
- Totally understandable why it’s not feasible to train an LLM on a byte stream and why we tokenize. Although I gu     See More wondering, let’s say we had the compute to do that. Are we losing too much semantic value that way? I get that probably would manifest the same on the other side but… I don’t know. Maybe I just need to think about it some more. It feels sort of like a Star Trek teleporter thing, where the person is sort of “vaporized” and then “reassembled” on the other side. 😂
- I guess, what is your general take on the intuition for SentencePiece? Sort of in alignment with my point above, are all those knobs and dials seeking the preserve that “semantic state”?
I think I’m answering the questions in my head as I type here. 😂 This is a new topic for me, and I’ve found it genuinely a lot of fun to think about. Thank you again for your work!    See Less
So, if you get to the Taylor Swift part, you probably going to go all the way to the end of the video?     See Less
Hello Andrei, the new era of AI has agitated me. With fast growing AI technology i dont even know if i should learn how to coding, programming now . Cause there a many no code tools b     See More oping right now. Im sure that my job will be among the first to be replaced by AI . What advice you can give a 27 yers old man who strive to change his carrer . But i dont know which direction i can pursue or what trend to follow?    See Less
Such an amazing video!     See Less
The last 20 secs is the best lol     See Less
Thank you!     See Less
I was on interview few months back and the interviewer wanted me to implement this in 15 minutes. I failed at that time, not I would rock. Thanks for that.     See Less