The first scaling change was not another node. It was a bounded queue that exposed backpressure before requests reached the expensive work.
Field note11 min read
Put a queue in front of it before you scale anything
The first scaling change was not another node. It was a bounded queue that exposed backpressure before requests reached the expensive work.
Software engineeringArchitecture
Source links stay with the relevant section