Every modern large language model you use is almost certainly a Mixture-of-Experts model. Mixtral, DeepSeek-V3, GPT-OSS, the latest Kimi and
Continue readingInside Mixture-of-Experts: Routing, Load Balancing, and Why 671B Parameters Cost 37B
Most teams treat “thinking mode” as a switch. Turn it on and the model reasons through the problem step by
Continue readingThinking Inertia: Why LLMs Don’t Stop Reasoning When You Tell Them To
Every LLM application has two knobs that get blamed for everything: temperature and top-p. When outputs are boring, someone raises
Continue readingTemperature, Top-p, Top-k, and Min-p: How the LLM Sampler Actually Works
What this is: a chronology of the major LLM releases of 2026, paired with the loudest things the internet said
Continue readingEvery 2026 LLM Release, Paired With the Hype That Announced It — Scored for Accuracy
DeepSeeded? No — DeepSeek. In September 2026 the Chinese AI lab released a paper titled “DeepSeek-V4.1-Flash: Pushing the Limits of
September 2026 has been one of the densest months for AI releases in recent memory. Within the first 72 hours,
Three model releases in ten days have made one thing clear: the frontier story of late 2026 is not bigger
Alibaba’s Qwen team just shipped Qwen3.8-Max, and it arrives at a strange moment in the AI race. We’re past the
The AI landscape moves fast. In the span of a few weeks, we’ve seen several notable model releases that push
Moonshot AI has just dropped Kimi K3, and it’s a monster. At 2.8 trillion parameters, it’s the world’s first open-source
Continue readingKimi K3: Moonshot AI’s 2.8 Trillion Parameter Open-Source Behemoth