The History of LLMs
The history of LLMs in depth: from mechanical translation and AI winters to transformers and ChatGPT. By Turing Post.
Concepts
+2
15 min read
Oct 1, 2025
Reinforcement Learning: The Ultimate Guide to Past, Present, and Future
From the early trial-and-error concepts to today’s breakthroughs with RLHF, PPO, and GRPO, and where to go next, according to Andrej Karpathy and Richard Sutton.
AI 101
+3
12 min read
May 28, 2025
Decoding BERT: From Original NLP Game-Changer to Today's Efficient AI (feat. ConstBERT)
What is BERT in NLP? Learn how BERT works—MLM, NSP, fine-tuning—plus modern variants like RoBERTa, DistilBERT, ModernBERT, and ConstBERT in 2026.
Origins
+1
6 min read
Dec 14, 2024
Who came up with the term "attention"?
Dzmitry Bahdanau? Yoshua Bengio? Jürgen Schmidhuber? Inspired by Andrej Karpathy and in collaboration with Hugging Face, we clarify the history of "attention"
