Tag: runbook

Operational runbook for LLM production incidents: hallucination events, model outages, cost spikes, safety failures, and degraded quality. Includes severity levels, escalation paths, diagnostic steps, and recovery procedures.

Runbook for warming caches after deployment, restart, or incident: identify hot keys, preload strategies, progressive warmup, health checks, and rollback procedures with code examples and automation scripts.

A runbook for operating, monitoring, and troubleshooting ETL jobs: startup, shutdown, health checks, common failures, diagnostics, and recovery.

A template to plan and document backup verification tests, ensuring restore procedures work before an emergency.

A runbook template for safely migrating data between systems including pre-migration checks, rollback procedures, and post-migration validation.

A step-by-step runbook for upgrading project dependencies safely.

A template for planning and executing disaster recovery tests including failover validation, data integrity checks, and recovery time measurement.

A template for transferring operational context between on-call shifts including active incidents, ongoing alerts, and system health status.

A template documenting common alerts and step-by-step response procedures for on-call engineers.

A step-by-step runbook for executing database failover procedures safely with minimal downtime and data loss.

A template for defining who owns a service, what it does, how to operate it, and where to find critical information when things go wrong.

Runbook for handling and replaying dead letter queue messages in Kafka and RabbitMQ: DLQ setup, inspection procedures, root cause analysis, replay strategies, monitoring alerts, and automation scripts for failed message recovery.

A standardized runbook for responding to alerts: triage, diagnosis, mitigation, resolution, and post-incident steps with escalation paths.

A runbook for encryption key rotation covering key types, rotation schedules, zero-downtime procedures, dual-key migration, verification, and rollback.

Runbook for diagnosing and mitigating serverless cold starts: causes, measurement, optimization strategies (provisioned concurrency, warmers, initialization tuning), and monitoring with code examples for AWS Lambda, Azure, and GCP.

A database migration runbook template for executing schema changes safely with rollback procedures, verification steps, and communication plans.

A reusable template for operational runbooks: incident response, deployment procedures, and routine tasks.

A practical guide to incident response: declaring incidents, building an incident command structure, communication protocols, and reducing mean time to resolution with structured processes.

A practical guide to disaster recovery planning: defining RTO and RPO, backup strategies, multi-region failover, and building recovery runbooks that minimize downtime.