This is the blog of Ronald Bartels that wanders on and off the subject of problem management (that is how it started), but it is best described by Ray who says this is Daddy's thoughts! Like the best music is from the Eighties and a wee dram helps in solving most inconveniences.
It's not about backup but resilience - lessons from a hot Perth
Over in Perth, the Internet melted (read about it here).
What is obvious is that these guys never designed a resilient network,
neither did they test it. Most people would say they should have had
everything backed up and duplicated and deployed at an alternative
location. Well, that might be a strategy but does it really address the
problem? No, an ISPs customers are only interested in receiving
uninterrupted service or as a worse case scenario, a degraded service
that isn't debilitating.