The History of LLMs

The history of LLMs in depth: from mechanical translation and AI winters to transformers and ChatGPT. By Turing Post.

The History of LLMs

The Story of AI Winters and What it Teaches Us Today (History of LLMs. Bonus)

16 min read

May 15, 2026

The Story of AI Winters and What it Teaches Us Today (History of LLMs. Bonus)

In the long run, AI was possible and promising, but its wave had yet to rise

Ksenia Se, +1

The History of LLMs

6 min read

Dec 14, 2024

Who came up with the term "attention"?

Dzmitry Bahdanau? Yoshua Bengio? Jürgen Schmidhuber? Inspired by Andrej Karpathy and in collaboration with Hugging Face, we clarify the history of "attention"

Ksenia Se

The History of LLMs

6 min read

Aug 16, 2023

The History of LLMs Series – Recap

Uncovering the origins of contemporary large language models and unveiling ChatGPT's success

Ksenia Se, +1

The History of LLMs

AI Bubble Bursting into AI Winter – yes or no? (History of LLMs #5)

6 min read

Aug 11, 2023

AI Bubble Bursting into AI Winter – yes or no? (History of LLMs #5)

Navigating the AI Hype: Deep Analysis of the Situation with Strategies For Investors

Ksenia Se, +1

The History of LLMs

The secret sauce behind ChatGPT and other important LLMs (History of LLMs #4)

10 min read

Jul 14, 2023

The secret sauce behind ChatGPT and other important LLMs (History of LLMs #4)

Unveiling the Impact of LLMs on Natural Language Processing and the Future of AI

Ksenia Se, +1

The History of LLMs

There Would Have Been No LLMs Without This (History of LLMs #3)

9 min read

Jul 7, 2023

There Would Have Been No LLMs Without This (History of LLMs #3)

Game-changing 1990s: the bloom of NN, success of RNNLM and backpropagation, introduction of GPUs and advent of Transformers

Ksenia Se, +1

The History of LLMs

Fascinating birth of AI, first chatbots and the power of US Department of Defense (History of LLMs #2)

10 min read

Jun 23, 2023

Fascinating birth of AI, first chatbots and the power of US Department of Defense (History of LLMs #2)

Discover the pivotal role of cognitive sciences in the rebirth of NLP and the journey from machine translation to artificial intelligence

Ksenia Se, +1

The History of LLMs

The Era of Mechanical Translation and How It Crashed (History of LLMs #1)

8 min read

Jun 16, 2023

The Era of Mechanical Translation and How It Crashed (History of LLMs #1)

A new fascinating series about the history of large language models (LLMs)

Ksenia Se, +1