Skip to main content

MAX_RESPONSE_BYTES

Constant MAX_RESPONSE_BYTES 

Source
pub const MAX_RESPONSE_BYTES: usize = 40_000;
Expand description

Maximum response size in bytes.

This constant is the single source of truth for the 10K token cap. Change it here to adjust the cap for all actions simultaneously.

§CUSTOMIZE: Adjusting the cap

For services that return very dense data (e.g. binary-encoded metrics), you may want a lower cap. For services that return sparse text (e.g. configuration files), the cap may be relaxed slightly.

Never exceed 100KB (25K tokens) — at that size, agents start losing context from earlier in the conversation.