The History of LLMs

Uncovering the origins of contemporary large language models and unveiling ChatGPT's success

All Posts

The History of LLMs

Dec 14, 2024

Who came up with the term "attention"?

Dzmitry Bahdanau? Yoshua Bengio? Jürgen Schmidhuber? Inspired by Andrej Karpathy and in collaboration with Hugging Face, we clarify the history of "attention"

Ksenia Se

The History of LLMs

Aug 16, 2023

The History of LLMs Series – Recap

Uncovering the origins of contemporary large language models and unveiling ChatGPT's success

Ksenia Se, +1

AI Bubble Bursting into AI Winter – yes or no? (History of LLMs #5)

The History of LLMs

Aug 11, 2023

AI Bubble Bursting into AI Winter – yes or no? (History of LLMs #5)

Navigating the AI Hype: Deep Analysis of the Situation with Strategies For Investors

Ksenia Se, +1

The secret sauce behind ChatGPT and other important LLMs (History of LLMs #4)

The History of LLMs

Jul 14, 2023

The secret sauce behind ChatGPT and other important LLMs (History of LLMs #4)

Unveiling the Impact of LLMs on Natural Language Processing and the Future of AI

Ksenia Se, +1

There Would Have Been No LLMs Without This (History of LLMs #3)

The History of LLMs

Jul 7, 2023

There Would Have Been No LLMs Without This (History of LLMs #3)

Game-changing 1990s: the bloom of NN, success of RNNLM and backpropagation, introduction of GPUs and advent of Transformers

Ksenia Se, +1

The Story of AI Winters and What it Teaches Us Today (History of LLMs. Bonus)

The History of LLMs

Jun 30, 2023

The Story of AI Winters and What it Teaches Us Today (History of LLMs. Bonus)

In the long run, AI was possible and promising, but its wave had yet to rise

Ksenia Se, +1

Fascinating birth of AI, first chatbots and the power of US Department of Defense (History of LLMs #2)

The History of LLMs

Jun 23, 2023

Fascinating birth of AI, first chatbots and the power of US Department of Defense (History of LLMs #2)

Discover the pivotal role of cognitive sciences in the rebirth of NLP and the journey from machine translation to artificial intelligence

Ksenia Se, +1

The Era of Mechanical Translation and How It Crashed (History of LLMs #1)

The History of LLMs

Jun 16, 2023

The Era of Mechanical Translation and How It Crashed (History of LLMs #1)

A new fascinating series about the history of large language models (LLMs)

Ksenia Se, +1

The History of LLMs

Who came up with the term "attention"?

The History of LLMs Series – Recap

AI Bubble Bursting into AI Winter – yes or no? (History of LLMs #5)

The secret sauce behind ChatGPT and other important LLMs (History of LLMs #4)

There Would Have Been No LLMs Without This (History of LLMs #3)

The Story of AI Winters and What it Teaches Us Today (History of LLMs. Bonus)

Fascinating birth of AI, first chatbots and the power of US Department of Defense (History of LLMs #2)

The Era of Mechanical Translation and How It Crashed (History of LLMs #1)

Turing Post