LLM Digest

Story

infoq_ai_ml · Oct 27, 2026 · news

Source brief

Uber Moves Beyond CPU Cores with Performance-Aware Scheduling for Stateful Workloads

infoq.comOct 27, 2026
original source linked

In brief

Uber has introduced Normalized Compute Units (NCUs) to make CPU allocation more consistent across its highly heterogeneous server fleet. By Craig Risi

Read the original at infoq.com →Open in live feed

Uber Moves Beyond CPU Cores with Performance-Aware Scheduling for Stateful Workloads

Earlier in this thread 4 items

PhaseGate: Phase-Aware CPU Retrieval Scheduling for On-Device LLMs on Unified Memory

Agent Memory: Characterization and System Implications of Stateful Long-Horizon Workloads

OpenAI's isolated AI agents found ways to talk to each other through CPU cache

Deepseek's latest AI model is smarter than ever, but its low running costs come at a price — uses only one-quarter of the HBM and one-eighth of SSD storage but still battles hallucinations in agentic workloads