Speculative Decoding in vLLM: Draft, Verify, and Cut Latency Without Losing the Distribution
Large language model inference has an awkward performance profile: the GPU does enormous math, then waits. Every token requires a
Tag: LLM
5 Trending GitHub Repos: Quantized Vector Search, Static GPU Binaries, and a Fly With Real Neurons
The commits that caught my attention this week range from a vector database that shrinks a 31 GB corpus into
Harness Scaling: How a State Machine Runtime Pushed Agents to 95.3% on Terminal-Bench
The default answer to “make the agent better” is a better model. But a growing pile of evidence says that
The Post-Training Era: GLM-5.3, Gemini 3.7 Flash, and the Week the Base Model Stopped Mattering
Three model releases in ten days have made one thing clear: the frontier story of late 2026 is not bigger
5 Trending GitHub Repos: Local Video Generation, Compile-Time Distributed Safety, and Git History Surgery
Every week a handful of open source projects break out of the usual noise and start accumulating real traction. This
Qwen3.8-Max: 2.4T Parameters, Open Weights, and a 12-Point Jump in Agentic Computer Use
Alibaba’s Qwen team just shipped Qwen3.8-Max, and it arrives at a strange moment in the AI race. We’re past the
Beyond Math and Code: How SpyRL Turns Party Games Into Verifiable Training Signals for LLMs
Reinforcement Learning with Verifiable Rewards (RLVR) has become the engine behind modern reasoning models. The recipe is straightforward: let a
Building LLM Evaluation Pipelines: Metrics, Frameworks, and CI Integration
Shipping an LLM-powered feature without an evaluation pipeline is like deploying a microservice without health checks — it might work
Continue readingBuilding LLM Evaluation Pipelines: Metrics, Frameworks, and CI Integration
Metis: The First Memory Foundation Model That Learns to Remember
AI agents have gotten remarkably good at reasoning, perceiving, and acting. But ask one to remember what you told it
Continue readingMetis: The First Memory Foundation Model That Learns to Remember
5 Trending GitHub Repos: Multiplayer Agents, 2 GB LLMs, and AI Writing Discipline
Every Sunday, I scan the open source landscape for projects that are gaining real traction — not just stars, but
Continue reading5 Trending GitHub Repos: Multiplayer Agents, 2 GB LLMs, and AI Writing Discipline