
🎯50%
54:12
2017▲ 72 HN pts
Deep Unsupervised Learning: Foundations of Generative Pre-training
By Ilya Sutskever (UC Berkeley / OpenAI)
“Years before GPT-3, Ilya Sutskever derived why predicting the next token is equivalent to maximum likelihood compression of world structure. The true philosophical and mathematical origin of generative AI.”

![[1hr Talk] Intro to Large Language Models](https://img.youtube.com/vi/zjkBMFhNj_g/hqdefault.jpg)


