Kinetic observability, reimagined
  • Home

    Home Styles

    • Terminal
    • Blueprint
    • Signal
  • Product

    Platform

    • Features
    • Integrations
    • Changelog

    Content

    • Blog
    • Article Archive

    Discover

    • All Categories
    • Our Writers
  • Pricing
  • Company

    Company

    • About
    • Team
    • Contact
  • Pages

    Account

    • Login
    • Register
    • Password Reset
    • Username Reminder

    Content

    • Engineering
    • Single Article
    • Author

    Discover

    • All Tags
    • Search
    • Landing
Sign in Start free
Kinetic
  • Home
    • Terminal
    • Blueprint
    • Signal
  • Product
    • Features
    • Integrations
    • Changelog
    • Blog
    • FAQ
    • All Categories
    • Article Archive
    • Our Writers
  • Pricing
  • Company
    • About
    • Team
    • Contact
  • Pages
    • Landing
    • Single Article
    • All Tags
    • Search
    • Login
    • Register
    • Password Reset
    • Username Reminder
    • Engineering
    • Author
Sign in Start free
BLOG

Field notes from the on-call

Engineering deep-dives, incident retros and observability practice from the Helix team.

Browse
  • All posts
  • Engineering
  • Incident retros
  • Product
  • Tutorials
  • Practice
  • Culture
  • incident
  • metrics
  • slo
  • alerting
  • cost
  • latency
Topics All posts 241 Engineering Incident retros Product Tutorials Practice Culture
All articles // 61 posts · newest first
02 Apr
INCIDENT

A DNS TTL Nobody Remembered Set Off a Three-Hour Chase

Half our fleet found the new load balancer instantly. The other half kept hammering an IP that had been decommissioned an hour...

Marco Vidal Apr 2 2026 3 min
29 Mar
FIELD NOTES FROM THE ON-CALL

Writing runbooks your future self will thank you for

A runbook written for the person you are today is useless to the person you will be at 3 a.m. — tired, paged, and half-awake....

Arjun Mehta Mar 29 2026 2 min
26 Mar
INCIDENT

The On-Call Rotation That Finally Stopped Burning Us Out

We didn't fix on-call by paging people less. We fixed it by finally admitting our rotation math had been wrong for two years.

Lena Park Mar 26 2026 3 min
20 Mar
FIELD NOTES FROM THE ON-CALL

Log sampling that keeps the needles and drops the hay

Keeping every log line is expensive and mostly useless. Keeping the right one percent is cheap and mostly what you need. The...

Priya Raman Mar 20 2026 2 min
19 Mar
INCIDENT

What Breaks First: Notes From 50 Incident Reviews

I read every postmortem our team wrote over eighteen months looking for a pattern. There was one, and it wasn't the one I...

Priya Raman Mar 19 2026 3 min
12 Mar
INCIDENT

Chasing a Memory Leak That Only Appeared on Tuesdays

Three weeks of OOM restarts, always between Tuesday and Wednesday, never any other day. The pattern felt insane until we found...

Marco Vidal Mar 12 2026 3 min
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11

Page 8 of 11

// get started in minutes

Your next incident is coming. Be ready for it.

Free for 14 days. No credit card. Pipe your first logs in under five minutes.

Start free $helix init
Helix

Observability without the overhead. Logs, metrics and traces on one fast timeline.

Product

  • Features
  • Pricing
  • Integrations
  • Changelog

Developers

  • Blog
  • HelixQL
  • Search
  • All Tags

Company

  • About
  • Team
  • FAQ
  • Contact

Monthly dispatch

Incident retros, query tips and product news. No spam, unsubscribe anytime.

© 2026 Helix Labs, Inc. All rights reserved.
  • Privacy
  • Terms
  • Status