How do you handle lost webhooks in production?

Question

I've worked at several companies where we'd discover hours later that critical webhooks from Stripe/Shopify never arrived (deployment, timeout, bug, etc.). Every team ended up building the same solution: retry logic, dead letter queue, monitoring. Curious how others handle this: Do you rely on the provider's retry policy? Built your own reliability layer? Use a service? Just manually reconcile when it happens?

HackerNews · Accepted Answer

Handling lost webhooks in production is a common challenge. Most teams implement a combination of retry logic, dead letter queues, and monitoring to ensure reliability. While some providers like Stripe and Shopify offer retry policies, it's often not enough to guarantee delivery. Building a custom reliability layer or using a dedicated service can help mitigate the issue.

How do you handle lost webhooks in production?

Resources