The centralized approach here is smart - weve been rolling our own per-agent guardrails and the config drift becomes a nightmare. Curious if theres a latency hit on the hot path when evaluating 50+ controls? The benchmarks show ~91ms p99 which feels borderline for real-time chat.
The centralized approach here is smart - weve been rolling our own per-agent guardrails and the config drift becomes a nightmare. Curious if theres a latency hit on the hot path when evaluating 50+ controls? The benchmarks show ~91ms p99 which feels borderline for real-time chat.