Lessons from the Terminal

Twice-weekly field notes on infrastructure, AI, and systems.

What I built, what broke, and the evidence that changed the next decision.

Jul 2026 Observability

The Log I Will Actually Read

The log I imagine writing is comprehensive. It captures every branch, request, retry, timing detail, and internal state transition. Future me opens it, follows the trail with calm precision, and finds the answer hiding in line seven thousand.

4 min read Read →
Jul 2026 Infrastructure

Every Service Adds a Future Chore

A service doesn’t add one generic maintenance task. It adds work at every dependency boundary where its assumptions can diverge from the next version underneath it.

4 min read Read →
Jul 2026 Operations

What a Good Runbook Leaves Out

A runbook becomes less useful when it tries to contain everything its author knows. Background, architecture, troubleshooting, credentials, and every remembered exception accumulate around the actual procedure. The document feels comprehensive, but the operator has to excavate the next safe step ...

4 min read Read →
Jun 2026 Operations

The Maintenance Window Is Part of the Design

A maintenance window isn’t merely a polite time to make a change. It is a finite engineering resource. The design has to fit inside it with room for observation, correction, and retreat. When the change plan consumes the whole window on paper, the failure has already started; the clock just hasn’...

4 min read Read →
May 2026 Leadership

A Quiet System Is Not Always Healthy

Low-traffic systems age in place. They can sit for weeks looking perfectly composed while credentials expire, permissions drift, indexes lose contact with their sources, and background workers retain assumptions nobody has exercised since the last upgrade.

4 min read Read →
May 2026 Operations

Why I Write Down the Rollback Before the Change

The rollback used to be the last part of my change notes. I’d describe what I wanted to alter, list the commands, think through validation, and then add a reassuring line about putting things back if necessary.

3 min read Read →
May 2026 Productivity

Small Systems Make Ownership Obvious

Small systems have nowhere to hide their assumptions. That can feel limiting when I’m building one, but it’s a gift when I have to operate it later.

3 min read Read →
May 2026 Operations

What Chores Teach Me About Queues

Household chores are a brutally honest queueing system. Work arrives from ordinary life, the machines have fixed capacity, and completed-looking steps have a habit of producing another pile somewhere else.

3 min read Read →
May 2026 Product

I Stopped Treating Maintenance as an Interruption

Maintenance used to appear on my task list as evidence that the real work had been interrupted. A certificate needed attention, storage had tightened, an image needed rebuilding, or an operating system wanted a quiet restart. I’d clear the nuisance and return to building.

4 min read Read →
Apr 2026 Automation

The Work I Do Not Automate

The maintenance sequence I use for small systems contains an awkwardly manual step. After the reports are gathered and before any cleanup happens, I read the candidates and decide what not to touch.

3 min read Read →