LLM Digest
Subscribe

Story

triton_releases · Aug 31, 2026 · release

Source brief

Release 2.72.0 corresponding to NGC container 26.08

github.comAug 31, 2026
original source linked

Release highlights

  • Added a log callback option to the tritonserver C and Python APIs and to the common Logger , allowing an embedding application to route Triton log records in...
  • Fixed dynamic-batcher starvation caused by waiting_consumer_count drift, where the scheduler could stop dispatching work despite queued requests
  • Restored preserve_ordering semantics by reserving the completion-queue slot at enqueue time rather than at completion
Feed lens
agent

Continue reading

Read the original at github.com →Open in live feedRead that day’s brief

Earlier in this thread 4 items