Do you speed up your video before uploading? It sounds like x1.5 on normal speed.
Andrej Karpathy
446K subscribersThe Tokenizer is a necessary and pervasive component of Large Language Models (LLMs), where it translates between strings ...
Do you speed up your video before uploading? It sounds like...
232 Comments
Wes Roth
47.7k views • 4 days ago
TheAIGRID
22.3k views • 5 days ago
Wes Roth
61.1k views • 6 days ago
Wes Roth
26.7k views • 1 week ago
Wes Roth
54.9k views • 1 week ago
AI Jason
68.3k views • 1 week ago
TheAIGRID
36.6k views • 1 week ago
TheAIGRID
6.3k views • 1 week ago
TheAIGRID
19.6k views • 1 week ago
TheAIGRID
13.6k views • 1 week ago
Shelf will be hidden for 30 daysUndo
Wes Roth
51.6k views • 1 week ago
AI For Humans
598 views • 1 week ago
Wes Roth
60.7k views • 1 week ago
TheAIGRID
147.6k views • 1 week ago
TheAIGRID
42.4k views • 1 week ago
AI For Humans
3.0k views • 1 week ago
TheAIGRID
30.8k views • 2 weeks ago
Wes Roth
48.7k views • 2 weeks ago
Wes Roth
38.9k views • 2 weeks ago
TheAIGRID
32.0k views • 2 weeks ago
Wes Roth
59.0k views • 2 weeks ago
TheAIGRID
33.5k views • 2 weeks ago
TheAIGRID
85.7k views • 2 weeks ago
Wes Roth
91.6k views • 2 weeks ago
Morningside AI
8.0k views • 2 weeks ago
Wes Roth
138.8k views • 2 weeks ago
AI For Humans
763 views • 2 weeks ago
TheAIGRID
28.6k views • 2 weeks ago
Wes Roth
33.3k views • 2 weeks ago
AI Explained
123.1k views • 2 weeks ago
TheAIGRID
457.7k views • 2 weeks ago
AI For Humans
1.4k views • 2 weeks ago
TheAIGRID
21.7k views • 3 weeks ago
Wes Roth
28.4k views • 3 weeks ago
Wes Roth
48.5k views • 3 weeks ago
TheAIGRID
398.9k views • 3 weeks ago
Wes Roth
19.7k views • 3 weeks ago
TheAIGRID
31.3k views • 3 weeks ago
AI Jason
37.7k views • 3 weeks ago
Wes Roth
60.8k views • 3 weeks ago
Wes Roth
20.5k views • 3 weeks ago
TheAIGRID
18.1k views • 3 weeks ago
TheAIGRID
53.2k views • 3 weeks ago
Wes Roth
46.4k views • 3 weeks ago
Wes Roth
33.3k views • 3 weeks ago
Wes Roth
82.6k views • 3 weeks ago
Wes Roth
35.2k views • 3 weeks ago
TheAIGRID
40.1k views • 3 weeks ago
Wes Roth
37.3k views • 3 weeks ago
Wes Roth
16.2k views • 3 weeks ago
TheAIGRID
26.4k views • 3 weeks ago
AI Explained
115.9k views • 3 weeks ago
AI For Humans
2.9k views • 3 weeks ago
TheAIGRID
41.8k views • 3 weeks ago
Wes Roth
129.9k views • 4 weeks ago
TheAIGRID
40.3k views • 4 weeks ago
Wes Roth
39.1k views • 4 weeks ago
AI Jason
65.1k views • 4 weeks ago
TheAIGRID
40.6k views • 1 month ago
AI For Humans
373 views • 1 month ago
TheAIGRID
51.3k views • 1 month ago
TheAIGRID
19.7k views • 1 month ago
TheAIGRID
31.6k views • 1 month ago
TheAIGRID
103.6k views • 1 month ago
AI For Humans
3.5k views • 1 month ago
TheAIGRID
45.8k views • 1 month ago
TheAIGRID
56.0k views • 1 month ago
AI Explained
115.3k views • 1 month ago
AI For Humans
2.3k views • 1 month ago
AI For Humans
1.7k views • 1 month ago
AI Jason
27.2k views • 1 month ago
AI For Humans
334 views • 1 month ago
AI For Humans
2.6k views • 1 month ago
AI Explained
105.5k views • 1 month ago
AI Explained
130.2k views • 1 month ago
AI For Humans
1.5k views • 1 month ago
AI Jason
202.1k views • 1 month ago
AI For Humans
1.4k views • 1 month ago
AI Explained
177.3k views • 2 months ago
AI Jason
32.9k views • 2 months ago
AI Explained
150.6k views • 2 months ago
Andrej Karpathy
453.8k views • 2 months ago
AI Explained
240.7k views • 2 months ago
AI Jason
62.1k views • 2 months ago
AI Explained
187.2k views • 2 months ago
AI Explained
160.9k views • 3 months ago
AI Jason
87.5k views • 3 months ago
AI Explained
270.8k views • 3 months ago
AI Jason
60.6k views • 3 months ago
AI Explained
96.5k views • 3 months ago
AI Jason
7.1k views • 3 months ago
AI Explained
145.7k views • 3 months ago
AI Explained
133.0k views • 4 months ago
AI Explained
79.4k views • 4 months ago
AI Jason
16.1k views • 4 months ago
AI Explained
84.0k views • 4 months ago
AI Explained
74.5k views • 4 months ago
AI Explained
144.7k views • 5 months ago
AI Jason
68.5k views • 5 months ago
Morningside AI
4.1k views • 5 months ago
AI Explained
83.7k views • 5 months ago
AI Jason
134.2k views • 5 months ago
AI Jason
33.3k views • 5 months ago
Morningside AI
9.7k views • 5 months ago
AI Explained
229.0k views • 5 months ago
Andrej Karpathy
1.8M views • 5 months ago
AI Explained
112.8k views • 5 months ago
AI Explained
167.2k views • 5 months ago
AI Explained
156.8k views • 5 months ago
Morningside AI
26.0k views • 5 months ago
AI Jason
16.1k views • 6 months ago
AI Explained
96.4k views • 6 months ago
AI Jason
68.7k views • 6 months ago
AI Explained
120.6k views • 6 months ago
AI Jason
52.5k views • 6 months ago
AI Jason
19.1k views • 7 months ago
AI Jason
52.7k views • 7 months ago
AI Jason
28.6k views • 7 months ago
AI Jason
13.6k views • 7 months ago
AI Jason
183.4k views • 8 months ago
AI Jason
48.2k views • 8 months ago
AI Jason
26.5k views • 8 months ago
AI Jason
14.4k views • 8 months ago
Andrej Karpathy
4.2M views • 1 year ago
Andrej Karpathy
153.6k views • 1 year ago
Andrej Karpathy
167.4k views • 1 year ago
Andrej Karpathy
240.3k views • 1 year ago
Andrej Karpathy
269.9k views • 1 year ago
232 Comments
Do you speed up your video before uploading? It sounds like x1.5 on normal speed.
Can we extend the tokens adding new languages and fine tune the exiating model?
I have been follwing you channel for more than 1 year and man you create state of art DL videos hope we see you more on new topics like mamba
Very well done!
Some questions I am walking away pondering:
- Totally understandable why it’s not feasible to train an LLM on a byte stream and why we tokenize. Although I gu     See More
So, if you get to the Taylor Swift part, you probably going to go all the way to the end of the video?
Hello Andrei, the new era of AI has agitated me. With fast growing AI technology i dont even know if i should learn how to coding, programming now . Cause there a many no code tools b     See More
I was on interview few months back and the interviewer wanted me to implement this in 15 minutes. I failed at that time, not I would rock. Thanks for that.
Do you speed up your video before uploading? It sounds like x1.5 on normal speed.     See Less
Can we extend the tokens adding new languages and fine tune the exiating model?     See Less
I have been follwing you channel for more than 1 year and man you create state of art DL videos hope we see you more on new topics like mamba     See Less
Very well done!
Some questions I am walking away pondering:
- Totally understandable why it’s not feasible to train an LLM on a byte stream and why we tokenize. Although I gu     See More wondering, let’s say we had the compute to do that. Are we losing too much semantic value that way? I get that probably would manifest the same on the other side but… I don’t know. Maybe I just need to think about it some more. It feels sort of like a Star Trek teleporter thing, where the person is sort of “vaporized” and then “reassembled” on the other side. 😂
- I guess, what is your general take on the intuition for SentencePiece? Sort of in alignment with my point above, are all those knobs and dials seeking the preserve that “semantic state”?
I think I’m answering the questions in my head as I type here. 😂 This is a new topic for me, and I’ve found it genuinely a lot of fun to think about. Thank you again for your work!    See Less
So, if you get to the Taylor Swift part, you probably going to go all the way to the end of the video?     See Less
Hello Andrei, the new era of AI has agitated me. With fast growing AI technology i dont even know if i should learn how to coding, programming now . Cause there a many no code tools b     See More oping right now. Im sure that my job will be among the first to be replaced by AI . What advice you can give a 27 yers old man who strive to change his carrer . But i dont know which direction i can pursue or what trend to follow?    See Less
Such an amazing video!     See Less
The last 20 secs is the best lol     See Less
Thank you!     See Less
I was on interview few months back and the interviewer wanted me to implement this in 15 minutes. I failed at that time, not I would rock. Thanks for that.     See Less