CES 2026: AI compute sees a shift from training to inference

In recent years, the big money has flowed toward LLMs and training; but this year, the emphasis is shifting toward AI ...
VentureBeat

Inference framework Archon promises to make LLMs quicker, without additional costs

Join the event trusted by enterprise leaders for nearly two decades. VB Transform brings together the people building real enterprise AI strategy. Learn more Researchers from Stanford University‘s ...
NextBigFuture

Defeating Nondeterminism in LLM Inference by Thinking Machines

A research article by Horace He and the Thinking Machines Lab (X-OpenAI CTO Mira Murati founded) addresses a long-standing issue in large language models (LLMs). Even with greedy decoding bu setting ...
SDxCentral

AI inference crisis: Google engineers on why network latency and memory trump compute

Researchers propose low-latency topologies and processing-in-network as memory and interconnect bottlenecks threaten inference economic viability ...