Github et tu?
Yep, even super techies are not invincible.
On January 31st, 2017, GitHub suffered a major backup restoration failure for one of its products: The online service GitLab.com.
The failure was the result of accidental data removal from their primary database server. The aggravating factor was that the backups had not been made for a while due to a configuration error.
As a result, the company lost some production data including modifications to database data such as projects, comments, user accounts, and others. A total of 300 GB of customer data was lost.
Amazin' Outage
Thousands of online services store their data in the data centers of AWS.
This means that even a small tech glitch can take down
Netflix,
Slack, Airbnb, Pinterest, Reddit, Quora, and even
NASA.
The company states that this incident occurred after a "small addition of capacity" to its front-end fleet of Kinesis servers.
Have a Plan
But you can at least mitigate the risks by rolling back your product or feature in the case of an embarrassing emergency.
Join us today to thank our newsletter sponsor, LaunchDarkly. LaunchDarkly is the #1 platform for managing Feature Flags. Feature Flagging is the smart way to develop and release your code. Visit LaunchDarkly to avoid your own ring of failure.