Alyona Vert.

Topic 31: How to Reduce Memory Use in Reasoning Models

we explore how combining LightThinker and Multi-Head Latent Attention cuts memory and boosts performance

Topic 30: Everything You Need to Know about Knowledge Distillation

This is one of the hottest topics thanks to DeepSeek. Learn with us: the core idea, its types, scaling laws, real-world cases and useful resources to dive deeper

Topic 29: Inside the family of Smol models

We explore the power of datasets and their integration in Hugging Face's small language models family, particularly in SmolLM2.

Topic 28: What is Mixture-of-Mamba?

we discuss how to enable the Mamba Selective State Space Model (SSM) to handle multimodal data using the Mixture-of-Transformers concept and modality-aware sparsity

Topic 27: What are Chain-of-Agents and Chain-of-RAG?

We explore Google's and Microsoft's advancements that implement "chain" approaches for long context and multi-hop reasoning

Topic 26: What is test-time compute and how to scale it?

We dive into test-time compute and discuss five+ open-source methods for its effective scaling for deep step-by-step models' reasoning.

Topic 24: What is Cosmos World Foundation Model Platform?

World models are the next big thing that enables Physical AI. Let's explore how NVIDIA makes it happen

Topic 22: What is HtmlRAG, Multimodal RAG and Agentic RAG?

We explore in details three RAG methods that address limitations of original RAG and meet the upcoming trends of the new year

15 Agentic Systems and Frameworks of 2024

Topic 21: What is Natural Language Reinforcement Learning (NLRL)?

Explore how RL can be blended with natural language