The visible latency looked cheap. The connection lifetime, retries, and abandoned requests made the operating cost tell a different story.
Field note6 min read
Streaming responses cost more than you think
The visible latency looked cheap. The connection lifetime, retries, and abandoned requests made the operating cost tell a different story.
APIsReliability
Source links stay with the relevant section