Origins

Origins traces who coined the terms that shaped AI, how they spread, and why their meanings changed over time.

Origins

6 min read

Dec 14, 2024

Who came up with the term "attention"?

Dzmitry Bahdanau? Yoshua Bengio? Jürgen Schmidhuber? Inspired by Andrej Karpathy and in collaboration with Hugging Face, we clarify the history of "attention"

Ksenia Se

Turing Post is an AI newsletter for engineers, researchers, founders, and technical managers who want to understand how machine learning and AI actually work.

Built on more than two decades in tech and seven years focused on AI, we track the research that matters, the systems being built, and the ideas shaping the field, from LLMs and AI agents to JEPA, world models, retrieval, inference, evaluation, AI infrastructure, and agentic workflows.

Join 115,000+ professionals who rely on Turing Post for precise, grounded analysis of AI’s past, present, and future.