7 min read
Designing p99 latency budgets for API gateways
Why averages hide the latency your users feel, how to split a tail-latency budget across gateway stages, and how to verify it under load.
API
Research
Long-form analysis of how high-throughput server-side systems are designed, scaled, secured and kept running. Regulation appears only where it shapes engineering decisions.
7 min read
Why averages hide the latency your users feel, how to split a tail-latency budget across gateway stages, and how to verify it under load.
API
7 min read
How to make POST requests safe to retry with idempotency keys: storage design, request fingerprinting, concurrency and expiry.
API