2021-03-11
We have a major incident on SBG2. The fire declared in the building. Firefighters were immediately on the scene but could not control the fire in SBG2. The whole site has been isolated which impacts all services in SGB1-4. We recommend to activate your Disaster Recovery Plan.
BleepingComputer
Data center operator OVH says a fire destroyed some of its sites in France, affecting cyber threat intelligence company Bad Packets, game maker Rust, and others
Ax Sharma / BleepingComputer :
Update 5:20pm. Everybody is safe. Fire destroyed SBG2. A part of SBG1 is destroyed. Firefighters are protecting SBG3. no impact SBG4.
BleepingComputer
Data center operator OVH says a fire destroyed some of its sites in France, affecting cyber threat intelligence company Bad Packets, game maker Rust, and others
Ax Sharma / BleepingComputer :
Update 7:20am Fire is over. Firefighters continue to cool the buildings with the water. We don't have the access to the site. That is why SBG1, SBG3, SBG4 won't be restarted today.
BleepingComputer
Data center operator OVH says a fire destroyed some of its sites in France, affecting cyber threat intelligence company Bad Packets, game maker Rust, and others
Ax Sharma / BleepingComputer :
Update 4pm We plan to restart SBG1+SBG4+the network by Monday March,15 and SBG3 by Friday March,19. In RBX+GRA we have the stock of new servers, pcc, pci ready to be delivered for all the impacted customers. Of course for free. We will add 10K servers in the next 3-4 weeks.
BleepingComputer
Data center operator OVH says a fire destroyed some of its sites in France, affecting cyber threat intelligence company Bad Packets, game maker Rust, and others
Ax Sharma / BleepingComputer :
Update 1pm Plan for the next 1-2 weeks: 1) rebuilding 20KV for SBG3 2) rebuilding 240V in SBG1/SBG4 3) verifying DWDM/routers/switchs in the network room A (SBG1). checking the fibers Paris/Frankfurt 4) rebuilding the network room B (in SBG5). checking fibers Paris/Frankfurt
BleepingComputer
Data center operator OVH says a fire destroyed some of its sites in France, affecting cyber threat intelligence company Bad Packets, game maker Rust, and others
Ax Sharma / BleepingComputer :
Update 11:40am The network room in SBG1 is okey. 4 rooms destroyed. 8 rooms are okey.
BleepingComputer
Data center operator OVH says a fire destroyed some of its sites in France, affecting cyber threat intelligence company Bad Packets, game maker Rust, and others
Ax Sharma / BleepingComputer :
Update 11:20am All servers in SBG3 are okey. They are off, but not impacted. We create a plan how to restart them and connect to the network. no ETA. Now, we will verify SBG1.
BleepingComputer
Data center operator OVH says a fire destroyed some of its sites in France, affecting cyber threat intelligence company Bad Packets, game maker Rust, and others
Ax Sharma / BleepingComputer :
Update 10am. (I'm there). We finished to shutdown the UPS in SBG3. Now they are off. We are looking to enter into SBG3 and check the servers. The goal is to create a plan to restart , at least SBG3/SBG4, maybe SBG1. To do so, we need to check the network rooms too.
BleepingComputer
Data center operator OVH says a fire destroyed some of its sites in France, affecting cyber threat intelligence company Bad Packets, game maker Rust, and others
Ax Sharma / BleepingComputer :