Incident: Power distribution – iWeb-NE data center (Resolved)

February 10, 2015 by iWeb Technologies in: Status

Summary of the sequence of events:

- At 1:00pm February 10 2015, tests that are part of a regular maintenance plan were done on our UPS (uninterruptible power supply) units in our iWeb-NE data center. The power distribution from Hydro-Quebec was temporarily transferred to our generators for the duration of the maintenance.

- At 1:40pm February 10 2015, tests revealed that all UPS units were ok so the power distribution was transferred back to Hydro-Quebec.

- At 2:00pm February 10 2015, during the power distribution transfer to Hydro-Quebec, one of our UPS unit failed and encountered technical issues and was put on external bypass directly to Hydro-Qu├ębec. The failure caused one segment of our Smart Server, Cloud V1 and Cloud V2 (Based on Openstack) services to fail.

- At 3:00pm February 10 2015, our technical team found the problem that caused the failure and was working actively to fix the issue.

- At 4:50pm February 10 2015, our Smart Servers services were rebooted progressively and our Cloud V1 services were back online.

- At 5:10pm February 10 2015, our second generation Cloud Servers services (based on Openstack) were back online and our Smart Servers services were still rebooting progressively.

- At 7:00pm February 10 2015, our technicians fixed the issue and all services were back online.

Update #4- 7:00PM EST - The incident has been successfully resolved. In the coming hours, we will monitor the performance and the stability of the affected services to make sure that all is working normally.

We apologize for any inconvenience this situation may have caused. If you have any questions, please do not hesitate to contact our support team.

Thank you for your patience and understanding.

Update #3 – 5:10PM EST: Our second generation Cloud Servers services (based on Openstack) are back online and our Smart Servers services are still rebooting progressively.

Our technical team is actively working to fully restore all our services back to normal.

We will continue to communicate all updates.

Update #2 – 4:50PM EST: Our Smart Servers services are rebooting progressively. Our second generation Cloud Servers services (based on Openstack) will be back online shortly.

Our technical team is actively working to fully restore all our services back to normal.

We will continue to communicate all updates.

Update #1 – 3:30PM EST: Our technical team has found the issue affecting the power distribution on iweb-NE data center. One of our UPS (Uninterruptible power supply) has encountered technical issues. To temporarily fix the issue, the charges on the UPS on iWeb-NE are currently on external bypass directly to Hydro-Quebec so there will be no redundancy while fixing the UPS issue.

Our technical team is actively working on this, we will continue to communicate all updates.

No ETA for now but we will keep you posted.

Start: February 10, 2015 2pm EST
Estimated time of resolution: TBD

We are currently investigating a situation that might affect a segment of our electrical alimentation infrastructure on data center iWeb-NE data center.

Our technical team is actively working on finding a solution to this problem. We will regularly communicate with you about the status of this operation.

We apologize for any inconvenience this situation may cause. If you have any questions, please do not hesitate to contact our support team (http://www.iweb.com/contacts/).

Thank you for your patience and understanding.

Comments

No comments yet.