The History of LLMs

The history of LLMs in depth: from mechanical translation and AI winters to transformers and ChatGPT. By Turing Post.

The History of LLMs

The Story of AI Winters and What it Teaches Us Today (History of LLMs. Bonus)

16 min read

May 15, 2026

The Story of AI Winters and What it Teaches Us Today (History of LLMs. Bonus)

In the long run, AI was possible and promising, but its wave had yet to rise

Ksenia Se, +1

Concepts

Reinforcement Learning: The Ultimate Guide to Past, Present, and Future

15 min read

Oct 1, 2025

Reinforcement Learning: The Ultimate Guide to Past, Present, and Future

From the early trial-and-error concepts to today’s breakthroughs with RLHF, PPO, and GRPO, and where to go next, according to Andrej Karpathy and Richard Sutton.

Alyona Vert.

AI 101

Decoding BERT: From Original NLP Game-Changer to Today's Efficient AI (feat. ConstBERT)

11 min read

May 28, 2025

Decoding BERT: From Original NLP Game-Changer to Today's Efficient AI (feat. ConstBERT)

What is BERT, how does it work, and why does it matter in 2026? Covers MLM, NSP, fine-tuning, RoBERTa, DistilBERT, ModernBERT, NeoBERT, and ConstBERT

Alyona Vert.

The History of LLMs

6 min read

Dec 14, 2024

Who came up with the term "attention"?

Dzmitry Bahdanau? Yoshua Bengio? Jürgen Schmidhuber? Inspired by Andrej Karpathy and in collaboration with Hugging Face, we clarify the history of "attention"

Ksenia Se

The History of LLMs