All Stories

My entrepreneurial ideas cheat sheet

As an engineer working for large organizations, my goal is always to work on projects I can be proud of and learn a lot from while also benefiting the organization...

Load Balancing: The power of micro-batching

It’s no secret I am a big fan of the “power of two random choices” algorithm (or more generally best-of-k) for resource based load balancing. I have written several articles...

Load Balancing: A More Realistic Model

In my previous writing on load balancing, we applied various techniques to the simple “balls in bins” model. Simple models are great because they are easier to understand and easier...

Bloom Filters and Beyond: Probabilistic Membership in Practice

Optimizing large systems is incredibly satisfying. Very few things are more exciting than seeing a large baseline shift in your metrics after a clever new algorithm is deployed. Optimization can...

Load Balancing: A Counterintuitive Improvement to the Best-of-K Algorithm

In my previous post, we built an intuition for how the “Best of two” algorithm improves load balancing by making it extremely hard to get too far from the optimal...

Load Balancing: The Intuition Behind the Power of Two Random Choices

In dynamic resource allocations and load balancing, one of the most well-known and fascinating algorithms is the so-called “power of two random choices,” which proposes a very simple change to...