Start With Low-Risk Checks
Prefer read-only or low-risk checks unless the runbook explains why a mutating step is the safest first action.
Operations standard
Verification RequiredUse this standard to draft operator runbooks with symptoms, first checks, diagnosis, remediation, escalation, evidence capture, limits, and reviewer routing that are clear before a responder needs them.
| Section | Purpose | Approval check |
|---|---|---|
| Summary | State the incident shape, affected product surface, severity rule, and first safe action. | Owner confirms scope and product boundary. |
| Symptoms | List user-facing and operator-facing signals with source, severity, and evidence to capture. | Operations reviewer confirms signals are actionable. |
| Prerequisites and safety | Name access, environment, privacy, data sensitivity, and commands that must not be run first. | Operations and support reviewers confirm safety boundaries. |
| First checks | Provide read-only or low-risk checks before remediation. | Docs QA reviewer confirms commands and expected output are inspectable. |
| Diagnosis | Map findings to likely causes and evidence records. | Product SME confirms the cause map is not stronger than current evidence. |
| Remediation | Give stepwise remediation, verification, rollback, and follow-up actions. | Operations reviewer confirms steps are safe for the stated scope. |
| Escalation | Name escalation triggers, owners, evidence bundle contents, and redaction rules. | Support reviewer confirms handoff expectations. |
| Evidence | Track source, test, fixture, release note, support record, or manual review evidence. | Evidence owner keeps status and last checked date current. |
| Limits and next steps | State unsupported modes, unreviewed claims, and related runbooks or limits pages. | Docs lead confirms the runbook does not overclaim. |
| Severity | Use when | Required action |
|---|---|---|
| P1 | Broad customer-visible service interruption, data admission stopped, or unsafe remediation risk. | Escalate immediately, capture evidence before mutation, and keep support informed. |
| P2 | A product workflow, tenant, stream, bucket, dataset, or operator path is blocked for a subset of users. | Run first checks, capture evidence, and escalate if no safe remediation exists. |
| P3 | Degraded, intermittent, or repeatable symptom with a known workaround or limited scope. | Diagnose, remediate when safe, and file follow-up evidence. |
| P4 | Question, validation gap, maintenance preparation, or docs-only correction. | Link the owning page and update evidence before stronger guidance is published. |
| Reviewer | Reviews | Status values |
|---|---|---|
| Product SME | Product behavior, supported surface, known limits, and maturity. | pending, approved, changes-requested, deferred |
| Operations reviewer | First checks, remediation safety, rollback, and verification. | pending, approved, changes-requested, deferred |
| Support reviewer | Escalation triggers, customer handoff, support bundle contents, and exclusions. | pending, approved, changes-requested, deferred |
| Docs QA reviewer | Commands, expected output, evidence records, and repeatability. | pending, approved, changes-requested, deferred |
| Security or privacy reviewer | Auth, secrets, tenant data, logs, traces, support bundles, and redaction rules when present. | pending, approved, changes-requested, deferred |
| Evidence type | Use for | Required fields |
|---|---|---|
| Source | Route handler, configuration, runtime code, script, or README. | Path, owner, date checked, status, and what the source does not prove. |
| Test | Smoke test, diagnostic script, automation output, or fixture-backed check. | Command, target environment, expected result, owner, date checked, and covered behavior. |
| Manual review | Reviewer-run procedure, incident review, or support acceptance. | Reviewer, date, scope, decision, follow-up, and limits. |
| Support record | Support bundle, redacted log excerpt, incident note, or customer handoff artifact. | Redaction status, owner, sensitive fields excluded, date, and retention boundary. |
Prefer read-only or low-risk checks unless the runbook explains why a mutating step is the safest first action.
Capture evidence before a step can overwrite logs, state, queues, segments, caches, WAL files, or diagnostics.
Keep secrets, bearer tokens, customer payloads, tenant identifiers, personal data, and proprietary traces out of support bundles unless a reviewed redaction path exists.
Internal standards and templates define runbook structure, evidence expectations, and handoff requirements. Public pages should show the reviewed runbook pattern without publishing private source locations.
Available: DOCS-050
Use ObjectDB operator runbooksUse this template for health checks, platform capabilities, S3 gateway limits, local adapter caveats, and support evidence.
Available: DOCS-051
Use Message Broker operator runbooksUse this template for health, metrics, audit, diagnostics, storage pressure, quota rejection, replication status, and support evidence.
Available: DOCS-052
Use LogDB operator runbooksUse the same structure for OTLP admission, WAL, segment bundle, query, and BYOC preflight troubleshooting.
Available: DOCS-053
Use Concordia validation runbooksRecord what each Cache, Gateway, Storage, TSDB, and active-service validation proves and does not prove.
Available: DOCS-054
Use observability and audit guideRoute health, metrics, audit, logs, diagnostics, support bundle evidence, and privacy-safe handoff through cross-product guidance.
Available: DOCS-055
Use troubleshooting indexRoute symptom-first checks to the right product runbook before drafting new remediation guidance.
Available: DOCS-056
Use support bundle and privacy pageApply bundle contents, exclusions, redaction expectations, approval triggers, and privacy review boundaries.