Load Balancing Beyond Round Robin: Least Outstanding Requests and Consistent Hashing
Here is a failure mode that shows up in every system with more than two backends: round robin distributes requests
Continue readingLoad Balancing Beyond Round Robin: Least Outstanding Requests and Consistent Hashing