Release 2.71.0 corresponding to NGC container 26.07
Added a streaming tool-call parse buffer limit to the OpenAI-compatible frontend to prevent excessive memory usage during streaming tool calls · PyTorch backend: Enabled PyTorch 2 batching and added support for loadin... Context & related coverage →