Developments that matter in production
What changed, how it works and what it means for the people running reliable systems.
33 stories · 25–33
How we reportNVIDIA reports generation falling from 156.6 to 34.2 seconds on its example workload. The eight-device layout also changes how much capacity remains for other requests.
Background reading: Platform engineeringSWE-Serve checks coding-agent patches through a running SGLang server. In NVIDIA’s experiment, adding live-serving checks reduced the pass rate for the same patches.
Background reading: AI in productionAntigravity’s SDK supports Gemma through LiteRT and compatible local model servers. A hybrid cloud planner offers another arrangement, with filenames and task descriptions sent off-device.
Background reading: AI in productionAn eight-B200 test retained 96.1% to 98.2% of baseline output-token throughput with confidential computing enabled. Its software and workload define what that comparison covers.
Background reading: Platform engineeringGPT-6 Sol and Luna combine lower token rates with cache-write and cache-read pricing. A repeated prompt can cost less even though its first cached write carries a premium.
Background reading: AI in productionThe alliance supports storage, generation and flexible AI workloads as ways to change grid demand. For a scheduled evaluation, a safe pause can still miss the deadline the job serves.
Background reading: Platform engineeringClaude’s on-demand compaction lets an application replace older conversation history with a signed summary. A conditional restart shows why the summary must preserve relationships between instructions.
Background reading: AI in productionClaude Enterprise’s Compliance API beta now includes Chrome-session transcripts. Tool exchanges help locate an attempted action; the destination’s records establish whether it took effect.
Background reading: AI in productionSplunk’s September releases combine agent traces, evaluations and token-cost monitoring. A rejected incident summary shows how retries and human corrections affect the apparent saving.
Background reading: Observability