Nobody ever wrote the code that lets ChatGPT write Python. Not one line of it. 🤯 Here's how a large language model actually gets built, step by step: 1️⃣ Data. Trillions of words of books, web pages, code and forums, then cleaned: duplicates removed, spam filtered, broken text stripped. One open dataset, FineWeb, is 15 trillion tokens of web text. 2️⃣ Tokens. The model never sees words.
2:57
Nobody ever wrote the code that lets ChatGPT write Python. Not one line of it. 🤯 Here's how a large language model actually gets built, step by step: 1️⃣ Data. Trillions of words of books, web pages, code and forums, then cleaned: duplicates removed, spam filtered, broken text stripped. One open dataset, FineWeb, is 15 trillion tokens of web text. 2️⃣ Tokens. The model never sees words.
已浏览 14.5万 次3 周前
TikTokrick.theengineer
展开
静态缩略图占位符