Back to blog

SRE Architecture Diagrams: SLOs, Error Budgets & Incident Response (2026)

How to diagram an SRE architecture: SLIs, SLOs, error budgets, burn-rate alerting, on-call escalation, incident command, and the postmortem feedback loop — with ready-to-use prompt templates.

R
Ryan·Senior AI Engineer
·

An SRE architecture diagram shows how a team operationalizes reliability — not just the services running in production, but the system built around them: the service level indicators being measured, the service level objectives and error budgets that govern how much risk the team can spend, the alerting pipeline that decides when a human gets paged, the escalation and incident command structure that responds, and the postmortem loop that feeds lessons back into the architecture. It is the visual counterpart to a team's SRE practice — the same way a network diagram documents infrastructure, an SRE diagram documents how reliability itself is engineered and defended.

Teams need this diagram for three reasons. First, it makes reliability targets and the incident-response path auditable — leadership, auditors, and customers asking about uptime commitments can be shown exactly how an SLO is measured and enforced, not just told a number. Second, it is the fastest way to onboard a new on-call engineer: a clear picture of who gets paged, in what order, and what runbook they should reach for beats a wiki page of scattered links. Third, it belongs in every postmortem — showing where in the pipeline detection, escalation, or mitigation broke down is far more useful than a paragraph of prose.

The core components of an SRE architecture

Service level indicators (SLIs)

A service level indicator is a directly measured quantity that reflects the user-facing health of a service. The four most common SLIs are availability (the proportion of requests that succeed), latency (the proportion of requests served faster than a threshold, usually expressed as a percentile like p99), error rate (the proportion of requests that return an error), and throughput ( requests or events processed per unit time). SLIs are almost always computed from raw telemetry — request logs, load balancer metrics, or traces — aggregated over a rolling window. In your diagram, show each SLI as a metric derived from a specific data source (load balancer access logs, application metrics, trace spans), not as an abstract box; the diagram should make it obvious exactly what is being counted and where that data comes from.

SLOs and error budgets

A service level objective is a target value for an SLI over a window of time — for example, "99.9% of requests succeed over a rolling 30-day window." The SLO is the central artifact of the SRE practice: it converts a vague goal ("be reliable") into a measurable, negotiated target. The error budget is simply 1 − SLO — the amount of unreliability the service is allowed to spend before it breaches its objective. A 99.9% SLO over 30 days gives roughly 43 minutes of allowed downtime; every incident, failed deploy, or elevated error rate spends down that budget. The burn rate is how fast the budget is being consumed relative to the window — a burn rate of 1x means the budget will be exactly exhausted at the end of the window; a burn rate of 10x means it will be exhausted in a tenth of the time. In your diagram, show the error budget as a stateful component sitting between the SLI measurement and the alerting pipeline — it is what alerting rules actually evaluate against, not the raw SLI.

Monitoring and alerting pipeline

The alerting pipeline is the path from raw metrics to a decision about whether to notify a human. Metrics are scraped or streamed into a time-series store, evaluated against alerting rules (typically burn-rate thresholds computed over multiple windows — see the multi-window multi-burn-rate pattern below), and rules that fire are routed to a paging system. Not every alert should page a human — low-urgency signals should route to a ticket queue or a dashboard, while only alerts indicating meaningful, budget-threatening burn should page on-call. Your diagram should show this triage explicitly: metrics store → alerting rule evaluation → severity routing → paging system, with the threshold or burn-rate window annotated on each rule.

On-call escalation architecture

When a page fires, it needs a defined path to a human who can act. The standard architecture has a primary on-call engineer who is paged first, a secondary on-call engineer (or the primary's manager) who is paged automatically if the primary doesn't acknowledge within a set window, and an escalation policy that defines the timeout and fallback chain — for example, page primary, wait 5 minutes, page secondary, wait 5 more minutes, page the team lead. This is typically implemented with a dedicated paging platform (described generically here as a paging/escalation service — tools like PagerDuty or Opsgenie implement this pattern) that owns on-call schedules, rotation, and notification channels (push, SMS, phone call). In your diagram, show the escalation policy as a sequential chain with explicit timeout values, and show which schedule (team, service, follow-the-sun) feeds each tier.

Incident command structure

For incidents that exceed what a single on-call engineer can handle, SRE practice defines an incident command structure: an incident commander who coordinates the response and makes decisions, a communications lead who owns status page updates and stakeholder communication so responders aren't interrupted, and subject-matter responders who work the technical mitigation. This structure is typically triggered automatically once an incident crosses a severity threshold (e.g., customer-facing outage, SLO breach imminent) and is coordinated through a dedicated incident channel and a declared incident record. Runbooks — documented, tested mitigation steps for known failure modes — are attached to specific alerts so responders aren't starting from zero. Your diagram should show the incident command roles as a structure that activates off the paging system, with runbooks linked to the alerts that trigger them.

Postmortem and blameless-retro feedback loop

The loop isn't complete until it feeds back into the system. A blameless postmortem documents the incident timeline, root cause, error budget impact, and — critically — concrete action items: new alerting rules, runbook updates, architectural changes to reduce blast radius, or SLO adjustments if the target proved unrealistic. Those action items should visibly feed back into the SLI definitions, alerting rules, and escalation policy shown elsewhere in the diagram. A good SRE architecture diagram closes this loop explicitly rather than treating the postmortem as a document that lives outside the system.

Common SRE architecture patterns

Pattern 1: Multi-window multi-burn-rate alerting

Rather than alerting on a single burn-rate threshold, this pattern evaluates burn rate over multiple time windows simultaneously — for example, a short window (5–60 minutes) paired with a longer window (1–6 hours), both required to exceed a burn-rate threshold before paging. This suppresses noise from brief blips while still catching fast-burning incidents quickly, and it distinguishes a page-worthy event from a ticket-worthy one. Diagram each alerting rule with its specific window pair and burn-rate multiplier, and show which rules route to paging versus a lower-urgency queue.

Pattern 2: Canary deployment tied to error-budget burn

Deployments roll out to a small canary slice of traffic first; the canary's SLIs are compared against the baseline, and if the canary's error rate or latency burns the error budget faster than an acceptable threshold, the deployment automatically rolls back before it reaches full traffic. This ties the release pipeline directly to the same SLO/error-budget system used for alerting, rather than treating deploys and reliability monitoring as separate concerns. Show the canary analysis step as a gate between the deployment pipeline and full rollout, with the rollback trigger wired to the error-budget burn rate.

Pattern 3: Circuit breaker and graceful degradation

Downstream dependency failures are contained with a circuit breaker that stops calling a failing dependency once its error rate crosses a threshold, failing fast instead of piling up latency and cascading the failure upstream. Paired with graceful degradation — serving a cached or reduced response instead of a hard error — this pattern protects a service's own SLOs from a dependency's outage. Diagram the circuit breaker as a stateful component sitting on the call path to each dependency, with its open/closed/half-open states and fallback behavior labeled.

Pattern 4: Chaos engineering and game-day feedback loop

Reliability assumptions are validated by deliberately injecting failure — killing instances, adding latency, cutting off a dependency — during scheduled game days or continuous chaos experiments, and observing whether the alerting pipeline, escalation policy, and runbooks actually work as designed. Findings feed the same postmortem loop as real incidents. Diagram the chaos experiment as a controlled fault injector attached to the production or staging path, with an explicit feedback arrow back into the alerting rules and runbook set it validated.

Prompt templates for SRE architecture diagrams

SLO monitoring and multi-burn-rate alerting pipeline

"Our checkout service emits request latency, status codes, and request counts to Prometheus via application metrics middleware. A recording rule computes availability and p99 latency SLIs over rolling windows. Two SLOs are tracked: 99.9% availability over 30 days and p99 latency under 300ms over 30 days, each with an error budget computed as 1 minus the SLO. Alerting rules evaluate burn rate across paired windows — a fast rule (5-minute and 1-hour windows, 14x burn-rate threshold) and a slow rule (30-minute and 6-hour windows, 6x burn-rate threshold). Rules that breach the fast threshold page on-call immediately via the paging system; rules that breach only the slow threshold create a ticket in the team's issue tracker. A Grafana dashboard shows current error-budget remaining for each SLO alongside historical burn-rate trends."

On-call escalation and incident command architecture

"An alerting rule that breaches the availability SLO's error budget fires a page to our paging platform. The escalation policy pages the primary on-call engineer first; if unacknowledged after 5 minutes, it escalates to the secondary on-call; if still unacknowledged after another 5 minutes, it escalates to the team lead and simultaneously opens an incident channel. Alerts above a severity-1 threshold automatically declare an incident, assigning an incident commander and a communications lead, and posting a status page update. The incident commander has access to a runbook linked directly from the alert, describing diagnostic steps and known mitigations for that failure mode. All incident actions and timestamps are logged to an incident record used to generate the postmortem afterward."

Canary deployment with automatic rollback tied to error-budget burn

"Our CI/CD pipeline deploys new releases to a 5% canary slice behind the load balancer before full rollout. A canary analysis job compares the canary's error rate and p99 latency SLIs against the stable baseline over a 15-minute observation window. If the canary's projected burn rate against the service's error budget exceeds a 10x threshold, the pipeline automatically rolls back the canary and blocks promotion, paging the on-call engineer with the comparison metrics attached. If the canary stays within threshold, traffic is progressively shifted to 25%, 50%, and 100%, with the same burn-rate check re-evaluated at each stage."

Chaos engineering and game-day testing architecture

"A scheduled game day injects controlled faults into our staging environment using a chaos engineering platform: terminating random instances in the checkout service, adding 2 seconds of latency to calls to the payments dependency, and cutting off the recommendations service entirely. During the experiment, we observe whether the circuit breaker on the payments call path opens as expected, whether the alerting pipeline pages on-call within the target detection time, and whether the on-duty engineer can resolve the page using the linked runbook without escalating. Results, gaps found, and follow-up action items are recorded in the same postmortem template used for real incidents and tracked to completion."

SLI/SLO reference

SLI typeExample SLO targetHow to diagram / measure it
Availability99.9% successful requests over 30 daysRatio of non-5xx to total requests, measured at the load balancer or gateway
Latencyp99 under 300ms over 30 daysPercentile of request duration from application or tracing spans
Error rateUnder 0.5% error responses over 7 daysErrored requests / total requests, broken out by error class
ThroughputSustain 5,000 req/s with no queueingRequests or events processed per second against capacity headroom

What a good SRE architecture diagram must show

  • SLO targets per service: Every critical service should have its SLO and window explicitly labeled — a diagram that shows services without their reliability targets can't answer the basic question of how reliable the system is supposed to be.
  • Alerting thresholds and burn-rate windows: Show the specific burn-rate multiplier and time window each alerting rule evaluates, and where it routes — paging versus ticketing. This is what separates a useful diagram from a vague one.
  • Escalation path: Show the full chain from primary on-call through secondary and incident command, with timeout values at each hop.
  • Blast-radius and rollback mechanism: Show how a bad deploy or failing dependency is contained — canary gates, automatic rollback triggers, and circuit breakers — not just how it's detected.
  • Dependency graph for blast-radius analysis: Show which services depend on which, so responders can reason about blast radius during an incident instead of discovering it live.

Frequently asked questions about SRE architecture

What is an SRE architecture diagram?

An SRE architecture diagram shows how a team engineers and defends reliability for a service — the SLIs being measured, the SLOs and error budgets that govern acceptable risk, the alerting pipeline that decides when to page a human, the on-call escalation and incident command structure that responds, and the postmortem loop that feeds lessons back into the system. It documents the reliability practice itself, not just the production infrastructure it protects.

What is an error budget and how do I diagram it?

An error budget is the amount of unreliability a service is allowed to have while still meeting its SLO, calculated as 1 − SLO. A 99.9% SLO leaves a 0.1% error budget over the measurement window. Diagram it as a stateful component that sits between the raw SLI measurement and the alerting pipeline: the SLI feeds a running calculation of budget remaining, and alerting rules evaluate the rate at which that budget is being burned (the burn rate) rather than the raw SLI value directly.

What's the difference between an SLA, SLO, and SLI?

An SLI is the measured metric (e.g., percentage of successful requests). An SLO is the internal target for that metric (e.g., 99.9% over 30 days) — the objective the team engineers toward. An SLA is a contractual promise to a customer, usually built with a looser target than the internal SLO and tied to a remedy (like service credits) if breached. In practice, SLOs should be stricter than SLAs so the team gets warned by its own alerting before a customer-facing contractual breach occurs.

Related guides: OpenTelemetry architecture diagrams, disaster recovery architecture, system design best practices, and DevSecOps architecture diagrams.

Ready to try it yourself?

Start Creating - Free