latency budget
The total time a workflow can spend on model calls, retrieval, tool calls, and UI updates before users lose patience or trust. Forces caching and architectural choices.
The latency budget forced the FDE to cache policy snippets.
The latency budget forced the FDE to cache policy snippets.