Fifteen years building and scaling distributed systems, across the industry's move from bare-metal servers and monoliths to cloud-native, Kubernetes and GitOps. I take on the work teams postpone: paying down technical debt, building deployment from nothing, and keeping systems running.
Six shifts the industry has since packaged and sells ready-made. I worked through them before anything was ready-made.
It Is Rarely the Database
2018
A year on storage under load: the bottleneck is almost never the engine, it is the shape of the questions asked of it.
A year spent on storage under load taught the thing that keeps being true: the bottleneck is almost never the engine, it is the shape of the questions being asked of it.
Sharding, replication and caching all help. A corrected query usually helps more, costs nothing to run, and does not add a component that has to be operated for the next five years.