RPCValet: NI-driven tail-aware balancing of µs-scale RPCs
The Morning Paper
MAY 19, 2019
Last week we learned about the [increased tail-latency sensitivity of microservices based applications with high RPC fan-outs. Seer uses estimates of queue depths to mitigate latency spikes on the order of 10-100ms, in conjunction with a cluster manager. So what we have here is a glimpse of the limits for low-latency RPCs under load.
Let's personalize your content