Baichuan Intelligence: The AI Tiger Focused on Math and Healthcare
Inside Baichuan Intelligence — founder Wang Xiaochuan, Tsinghua roots, 12 LLMs, and why this $2.8B Chinese AI company is slowing down to win in healthcare.
LLaVA-o1 reasons step-by-step through 4 structured stages & stage-level beam search. How it works, benchmarks vs GPT-4o-mini & Gemini-1.5-pro, and where it falls short.
🌁#76: Rethinking Scaling Laws (when plateau is actually a fork)
we discuss Compound AI and test-time compute to challenge the scaling plateau and pave the way for smarter AI systems, along with our usual collection of interesting articles, relevant news, and research papers. Dive in!
Mixture-of-Depths lets transformers skip layers for low-priority tokens, cutting FLOPs by up to 50%. Learn how MoD routing works and how it compares to MoE.
Metacognitive AI — LLMs that monitor their own limits — is the next research frontier. Covers AI welfare, anthropomorphism debates, and top papers of the week.