The Engineer's Journal
Build Log

Building a Small Observability Lab

A build log for a local service playground designed to make latency, retries, and queue depth visible.

softwareinfrastructure
Reading progress saved on this device0%

The lab goal was modest: run two local services, inject delay into one, and watch how the other behaves.

What Was Built

The first service accepts requests and calls the second service. The second service can be configured to respond quickly, respond slowly, or fail. Metrics track latency, retries, error rate, and requests in flight.

What Worked

The useful part was not the services. It was the moment the graphs showed retry behavior increasing pressure on the dependency that was already struggling.

What Needs Improvement

The next version should add a queue and a circuit breaker. The lab should let a reader change one control at a time and see how the system responds.