The Computing Series

The Concept

The claim is simple: every production system has an algorithmic core. Find that core, and you understand the system’s performance behaviour at a level no operations runbook can give you.

The algorithmic core is not hidden. It is visible to anyone who knows where to look. The method for finding it has four steps:

  1. Find the bottleneck — identify the operation the system does at highest volume or with the most latency impact.
  2. Identify the data structure — what is the bottleneck operation being performed on? A list? A map? A graph?
  3. Identify the algorithm — what operation is being performed? Lookup? Traversal? Sort? Partition?
  4. Name the complexity — once the algorithm is named, its complexity class follows. That tells you exactly how the system will behave as load increases.

This is not reverse engineering. It is pattern recognition. The same patterns appear repeatedly because engineering problems have structure, and the algorithms that solve them have been developed and refined over decades.


Read in the book →