Skip to main content
Todd Ekenstam

Todd Ekenstam

Builder & Tech Enthusiast

Recent

Beating the “Gate Rush”
Why Slow Start Matters for Resiliency and Operational Excellence

When a new pod comes online, it often experiences a gate rush: it’s declared “Ready,” immediately receives its full share of production traffic, and then falls over—spiking latency, throwing transient 5xx/504s, or flapping readiness. This is especially common for warm-up–sensitive services (JVM class loading/JIT, cache population, connection pool establishment, TLS handshakes, model loading, etc.).

·1215 words·6 mins
Regarding the Multi-Modal http2 support ask from Traffic, can we vend two ports (http-service-mesh and http2-service-mesh) and then document the dev teams should just use the correct one depending on the protocol being used? For different paved roads (agentic streaming, etc) the default vended template code can use the appropriate port depending on the use case. That way we don’t need to make this another configuration in AIR that the user needs to do.