Printed from http://www.electronista.com

Amazon: Netflix outage caused by deleted data

updated 06:56 pm EST, Mon December 31, 2012

Developer accidentally deleted data, causing outage

The Amazon Web Services outage that led to Netflix's downtime on Christmas Eve was caused by an accidental data deletion. This according to a summary posted Amazon on the AWS page. The summary states that one of a very small number of developers with access to AWS' Elastic Load Balancing Service deleted a portion of the ELB state data, causing the ELB control plane to experience high latency and error rates for API calls to manage ELB load balancers.

Amazon says the downtime persisted as long as it did because its technical teams were initially focused on API errors. The team had not noticed that ELB data had been deleted. It was only when the technical team working on the ELB dug into the system's load balancers that the missing data was discovered.

Amazon's statement says that the team has put in place a number of protections aimed at preventing this sort of outage in the future. The team has modified their system in order to prevent accidental modification without specific Change Management approval. They have also modified the data recovery process to take into account what the team learned in this most recent outage.



By Electronista Staff
Post tools:

TAGS :

toggle

Comments

Login Here

Not a member of the MacNN forums? Register now for free.

toggle

Network Headlines

toggle

Most Popular

Sponsor

Recent Reviews

Asus Chromebook C300

When Chromebooks hit the market back in 2011, consumers didn't know what to do with them. The low-cost laptops, powered by Google's Ch ...

Plantronics BackBeat Pro Bluetooth headphones

Looking for a pair of headphones that can do everything a user requires is a task that can take some study. Trying to decide on in-ear ...

Lemur BlueDriver

"Oh no, the check engine light is on…again! What one of the hundreds of reasons could it be this time? Probably going to cost a fort ...

Sponsor

toggle

Most Commented

 
toggle

Popular News