Story

In brief

Releasing llmbuffer - a Python library that maximizes LLM prompt cache hits. It handles dynamic context, compaction, and tool output truncation or summarization via flexible hooks. Expect 10x cost savings in typical u...