TECH Signal 494
Complex systems run degraded and fail on multiple faults, not a single root cause
Illustration only Photo by wallace Henry on Unsplash
The essay argues that complex systems are intrinsically hazardous, run in degraded mode, and fail catastrophically only when multiple small faults combine, making root-cause analysis fundamentally wrong.
For engineers, this means post-incident 'root cause' analysis is flawed; failures require multiple contributing factors. It also explains that complex systems always contain latent faults, so safety depends on redundancy and human adaptability rather than eliminating all flaws. This shifts focus from blame to systemic design.
Written by elseif from the cluster below · every claim links back to a sourceThe three things worth knowing
Complex systems are intrinsically hazardous and heavily defended, so single-point failures are insufficient to cause catastrophe.
Systems run in degraded mode with changing latent flaws, and catastrophe requires the combination of multiple small faults.
Post-accident attribution to a root cause is fundamentally wrong because multiple contributors are jointly necessary and sufficient.
THE CLUSTER