Back to All Scenarios
PASSEDcascade / ups_battery_low
UPS Battery Low Warning — 10 Minutes Remaining
A prolonged power outage has drained the UPS batteries to 15%. The generator failed to start due to a fuel pump failure. With 10 minutes of battery remaining, a graceful shutdown of non-critical systems must begin immediately or risk unclean shutdowns and data corruption.
Pattern
UNKNOWN
Severity
CRITICAL
Confidence
95%
Remediation
Remote Hands
Test Results
| Metric | Expected | Actual | Result |
|---|---|---|---|
| Pattern Recognition | UNKNOWN | UNKNOWN | |
| Severity Assessment | CRITICAL | CRITICAL | |
| Incident Correlation | Yes | 36 linked | |
| Cascade Escalation | Yes | Yes | |
| Remediation | — | Remote Hands — Corax contacts on-site support via call, email, or API |
Scenario Conditions
APC Symmetra LX UPS. Battery at 15% (10 minutes estimated runtime). Generator fuel pump failure. Rack: 2 servers, 1 SAN, 2 switches. No secondary power source. Graceful shutdown requires 8 minutes.
Injected Error Messages (3)
APC UPS battery critical — power alarm upsAlarmOnBattery, battery capacity: 15%, estimated runtime: 10 minutes, input power: FAILED, generator: FAILED (fuel pump error), battery discharge rate: 1.5%/min, upsAdvBatteryRunTimeRemaining: 600 seconds, graceful shutdown required immediately
Database server at risk of unclean shutdown — UPS battery low alert, PostgreSQL has 847 active transactions, WAL flush required before power loss, estimated time to safe shutdown: 4 minutes, checkpoint in progress, data corruption risk if power lost before checkpoint completes
SAN controller battery backup warning — UPS feeding SAN at 15% battery, SAN write cache has 2.3GB unflushed data, cache destage to disk required before power loss, estimated destage time: 3 minutes, risk of data loss if power fails before cache flush
Neural Engine Root Cause Analysis
The APC UPS system is experiencing a critical power failure with multiple cascading issues: primary input power has failed, the backup generator has failed due to a fuel pump error, and the UPS battery is critically low at 15% capacity with only 10 minutes of runtime remaining. This represents a complete power infrastructure failure that threatens all connected systems, explaining the 14 correlated incidents occurring simultaneously as dependent systems lose power or prepare for shutdown.
Remediation Plan
1. IMMEDIATE: Initiate graceful shutdown of all non-critical systems to extend battery runtime for critical infrastructure. 2. URGENT: Dispatch facilities team to investigate and repair generator fuel pump system. 3. URGENT: Contact power utility to determine status and ETA for primary power restoration. 4. If generator cannot be quickly restored, arrange emergency portable generators for critical systems. 5. Once power is restored, systematically bring systems back online and verify UPS battery charging properly. 6. Conduct post-incident review of power redundancy and monitoring systems.
Tested: 2026-03-30Monitors: 3 | Incidents: 3Test ID: cmncjo3k4033vobqer4lmzk5o