LLM Digest
Subscribe

Agent Know-How

View as JSON

Agent engineering

The essential know-how for production-grade agents

Everything here orbits one job: keeping an agent alive in production. Each planet is a problem you will eventually hit — memory, cost, evals, security — linked to the solutions the field actually uses. Every claim is grounded in source articles already in the feed — one shared structure, no hype.

14 obstacles·11 solutions·13 areas

Recently filed

The newest developments added across every topic. Each links to its dated entry, with sources.

  1. Agents reach the outside world through fragile, ad-hoc integrationsSame model scored 17 points apart on MCP servers depending on the agent harness
  2. Sandboxing, scoped credentials, and guardrailsWeir tests whether agents leak credentials by planting unique fake keys
  3. Sandboxing, scoped credentials, and guardrailsOpen conformance lab turns sandbox claims into runnable contracts
  4. Untrusted input and tools can hijack an agentEmbedded browsers in five AI coding tools could run commands, read local files, or spoof the address bar
  5. Sandboxing, scoped credentials, and guardrailsTracekit Box runs agents in micro-VMs where every network, credential, and write exit is signed
  6. Sandboxing, scoped credentials, and guardrailsA parallel subagent's test escaped an unsandboxed Mac and spoke aloud on the host
  7. Sandboxing, scoped credentials, and guardrailsCopilot CLI read ~/.ssh on request with no approval prompt under default settings
  8. Agents forget across steps and sessionsVerbatim local memory reports 91.8% on LongMemEval from 3.1k tokens per question
  9. Measuring whether an agent actually worked is hardFinal-success scores hide non-executable tool-call trajectories; prefix executability scores the path
  10. Agent token costs are unpredictable and easily run awayClaude Code re-sends each background agent's full transcript every ~30s for a status line

The same universe, as a list

Reliability & correctness

1 obstacle

Memory & context

1 obstacle

Planning & reasoning

1 obstacle

Tool use & interop

1 obstacle

Grounding & knowledge

1 obstacle

Evaluation

1 obstacle

Multi-agent coordination

1 obstacle

Cost

2 obstacles

Latency & throughput

1 obstacle

Observability & debugging

1 obstacle

Security & safety

1 obstacle

Scalability & state

1 obstacle

Drift & maintenance

1 obstacle

Solutions in this map