The History of LLMs

The history of LLMs: mechanical translation, AI winters, RNNs, Transformers, BERT, and ChatGPT — a complete series with deep-dives by Turing Post.

The History of LLMs

The Story of AI Winters and What it Teaches Us Today (History of LLMs. Bonus)

16 min read

May 15, 2026

The Story of AI Winters and What it Teaches Us Today (History of LLMs. Bonus)

In the long run, AI was possible and promising, but its wave had yet to rise

Ksenia Se, +1

AI Concepts & Techniques

Reinforcement Learning: The Ultimate Guide to Past, Present, and Future

15 min read

Oct 1, 2025

Reinforcement Learning: The Ultimate Guide to Past, Present, and Future

From the early trial-and-error concepts to today’s breakthroughs with RLHF, PPO, and GRPO, and where to go next, according to Andrej Karpathy and Richard Sutton.

Alyona Vert.

AI 101

Decoding BERT: From Original NLP Game-Changer to Today's Efficient AI (feat. ConstBERT)

12 min read

May 28, 2025

Decoding BERT: From Original NLP Game-Changer to Today's Efficient AI (feat. ConstBERT)

What is BERT in NLP? Learn how BERT works—MLM, NSP, fine-tuning—plus modern variants like RoBERTa, DistilBERT, ModernBERT, and ConstBERT in 2026.

Alyona Vert.

Origins

6 min read

Dec 14, 2024

Who came up with the term "attention"?

The attention mechanism is a neural network method introduced by Bahdanau & Bengio in 2014. Who named it, Schmidhuber's claim, and why it matters for Transformers.

Ksenia Se

The History of LLMs