Blog
Forum
StatusIncident: Power distribution – Data center CL [Resolved]
Monday, November 8, 9:50 EST: Latest and final update on the situation available here: http://blog.iweb.com/en/2010/11/incident-power-distribution-%e2%80%93-data-center-cl-resolved/6062.html.
–
21h45: Latest update is available here: http://blog.iweb.com/en/2010/11/incident-power-distribution-%e2%80%93-data-center-cl-update-3/6045.html
–
14h00: We are still actively working on putting the last affected servers back online. If your server is unreachable and that you have not opened a support ticket yet, we invite you to do so as soon as possible via the customer hub (https://account.iweb.com/en/auth/login).
–
13h25: Our third and last load transfer test has been completed successfully. In the meantime we keep working on the last few servers that need a manual intervention to complete their reboot. We will give you more information as it is available.
–
13h05: A second load transfer test has been completed successfully. We will do a third load test in the following minutes.
–
12h14 First load transfer test has been completed successfully. We will continue with additional tests in the following minutes.
–
11:22am: In the next following minutes we are going to proceed with emergency tests on the electrical panel transfer switch that was the cause of yesterday’s service interruption. We have to proceed as soon as possible because we do not want to depend on this piece of hardware in case of a new power outage. We will keep you informed as soon as this test is completed.
–
10:39am
There are still about 175 servers affected. We followed and replied to comments all night and posted some answers. We have many people on-site and we expect to accelerate the rate at which the remaining servers get back online. There are still power supply problems, failed hard drive problems, fsck required problems and other related problems. We should be able to fix most of the power supply problems left and run most of the fsck quite quickly but when hard disks have to be replaced and reinstalls needed it might take a little longer.
—
02:59am
We are still working on about 350 pending server issues. This will be the last status update inside the post about the issue for the moment, comment updates from our tech support & communications staff will continue. The staff will monitor the comments for issue priority and will concentrate on fixing the remaining affected servers as fast as they can. We will update the post again once the situation has changed significantly.
—
02:24am
Note from the comments (Sylvain) : There are still a couple of hundred servers down. Some for hardware problems, some for software problems. We are looking at them one by one.
—
02:22am
All three sections of the datacenter are back on electricity power.
—
01:52am
Around 372 dedicated servers still affected.
—
01:48am
A problematic dedicated server switch has been replaced. The 24 servers that were connected to this specific switch should now be back online.
—-
01:43am
Shared Hosting : File system check running on S016 and S040 as they were unstable after the reboots.
Dedicated Hosting : Thank you for your patience, we are trying to fix the remaining servers as fast as we can. Sylvain follows your comments and reports your priorities to the on-site teams while the rest of the team concentrates on tickets and our list of unreachable servers.
—-
01:35am
We still have around 400 servers down. It seems like we can fix about 50 servers per 20 minutes. It might accelerate once some “fsck” that are running will complete.
—-
01:14am
Our monitoring systems report around 450 dedicated servers (of around 3000 affected servers) would still be down. We are fixing those servers one by one according to our list, your tickets and the blog comments.
—-
01:05am
We have many hands fixing servers that did not reboot correctly. We will try to push for quick interventions for the tickets and server IDs you post in the comments but please try not to post those IDs multiple times. We are going as fast as we can and we have multiple hands&eyes in the DC but still each person in the DC can only fix one server at a time. Thank you for your patience. We understand the situation is still critical for some of you for which their servers did not reboot correctly and be assured that we treat the situation as critical for us too.
—-
12h59am
Shared hosting is 100% UP.
—-
12h49am
Noted by some customers : To those who have their servers still down, check your APC Remote Reboot and make sure your port is turned on. It seems some ports reset to Offline afer the outage.
Other note : If your servers are not back online yet, you might want to try to turn it OFF and ON again using your APC remote reboot port in your customers hub. Depending on where in the boot process your server is blocked it might help. But do not try it multiple times as you could make the problem worst. Turn the power OFF, wait for 30 seconds and turn the power back ON. Then wait to see if it reboots correctly.
—-
12h38am
Section 1 and 2 (unaffected) by the the outage are back on electricity power. Section 3 (the part of the DC that was affected by the outage, is still powered by generators.
—-
12h34am
iWEB-CL is 100% powered since about 20 minutes. About 90% of affected Shared Hosting servers are UP. Most of the dedicated servers should also be UP. Some dedicated servers might be affected by reboot problems, please report such problems by opening a support ticket. Once the ticket is opened you can come back here for updates or to report your issue and ticket number.
—-
12h21am
What happened?
Around 11pm, a fire near the iWEB-CL datacenter caused power disruptions. As electrical power was unstable, all power was automatically switched to generator power. The power transfer went normally for two our of three generators that power iWEB-CL when electrical power is not available. The third generator started but the transfer switch did not transfer power to the generator as it should have. We suspect the transfer switch control logic has been disrupted by the kind of power outage (the fact that it was related to a fire nearby) we are still investigating to find out why the power has not been transfered to the third generator.
Generator tests were completed successfully yesterday (Tuesday 2/2010) without load and successfully with full load last week (26/10/2010) with no indications of any potential problem. We run generator tests each week in order to prevent unplanned issues.
—
12:20am
Power is back, but some servers and services might need a manual fix in order to restart correctly. Some servers will need fsck and maybe power supply replacements. We are looking at the situation and have the required staff on-site to fix those problems quickly.
—
12:07am
The power is back. About 3000 serveurs were affected (1/3 of the datacenter) as the power was not switched to 1 of the 3 generators powering iWEB-CL. More details to come.
—-
12:01am
CL Data Center has 3 generators to power the data center in case of power failure. When we encounter the power failure tonight, the power was transferred to these generators. One the of the generators that was up and running was not able to take it’s load. The back up UPS took the charge until they were not able to keep the load. The problems seems to be in the switch that manage the electricity load. We have a big team taking care of the situation.
The generators are tested every week to make sure that we have a good back up and during the last test, we did not find any problems. We will get more information shortly on the what may be the cause of the problems. The problems affects close to 1.5 MW (3000 servers).
We will keep you up to date when we have more informations about the delay and the when the systems will be back online.
======================
Incident: Power distribution – Data center CL
Start: ~11:00PM EDT
Estimated time of resolution: N/A
We are currently investigating a situation that might affect a segment of our electrical alimentation infrastructure on data center CL Our technical team is actively working on finding a solution to this problem. We will regularly communicate with you about the status of this operation.
We apologize for any inconvenience this situation may cause. If you have any questions, please do not hesitate to contact our support team (http://www.iweb.com/contacts/). Thank you for your patience and understanding.
Comments
Promotion
Highest Rated
- Securing Wordpress against hackers
- An overview of RAID technology
- The Control Center, Our Next Generation Customer Hub
- iWeb launches its new website
- Top 9 Reasons why Web Hosting is Awesome
- A new logo for iWeb
- Smart Group: Optimizing Local Security
- Who has the coolest costume?
- 4 Tools to Create A Website Quickly & Easily
- Season’s Greetings from iWeb!
November 3rd, 2010 11:40 pm
server down for at least 40min!
November 3rd, 2010 11:41 pm
This sucks. My site is down at the most critical time of day. I can’t have this happening.
November 3rd, 2010 11:41 pm
it is not the first time it comes up this year… hope we’ll get a final resolve this time!
November 3rd, 2010 11:41 pm
This will be the 2nd time in less then 6 months that my servers have been unreachable… Iweb, you’ve cost me money, and now you will lose me as a customer!
November 3rd, 2010 11:42 pm
I’ll be moving to serverbeach this weekend … anyone else?
November 3rd, 2010 11:42 pm
A power problem? Bummer, hopefully it is resolved soon. *keeps fingers crossed*
November 3rd, 2010 11:42 pm
This is the first time my server is down with iWeb for the last 3 years. I hope everything will be ok, however it is too long downtime for my mission critical server.
November 3rd, 2010 11:43 pm
i will need some explanation by my account manager…. and as soon as possible…
November 3rd, 2010 11:43 pm
Any idea when this is going to be resolved?
November 3rd, 2010 11:43 pm
Yes, one of our servers is down too. I was on hold for about 20m on the phone before giving up. Also the Live Chat feature is also on hold for 20m….
November 3rd, 2010 11:44 pm
1 Down 3 up Heard there is a fire beside the Data Center not good! Hope they get things up and under control quickly.
November 3rd, 2010 11:44 pm
Where is the redundancy ?
November 3rd, 2010 11:44 pm
Mission critical can’t be run on iweb’s DC, i found this out the hard way. I gave you a chance the last time we had an outage… this time, your losing a customer
November 3rd, 2010 11:44 pm
I am loosing money every minute
November 3rd, 2010 11:44 pm
This must be a serious power issue. Hope their electrical team able to resolve it quickly. It is our first outage in a very long time with iWeb. Hope the server will come back up without issues afterwards.
November 3rd, 2010 11:44 pm
Guillaume … redundancy? LOL LOL Apparently its out the window…
November 3rd, 2010 11:45 pm
SERVER DOWN FOR ABOUT 30 MINUTES. THIS IS UNACCEPTABLE !
PLEASE CONTACT ME.
November 3rd, 2010 11:45 pm
Tiamo, its probably the first outage you noticed then … it happeneds all too often..
November 3rd, 2010 11:46 pm
Down since 8:10 PST ;(
November 3rd, 2010 11:46 pm
over 50 minutes of downtime!!! on a critical server(S!!!) …. You guys are unbelievable ..
November 3rd, 2010 11:46 pm
Please resolve this problem asap!!! All my servers are down. And my customers are calling and calling again to our office!!!.
November 3rd, 2010 11:46 pm
Finally got in touch with customer service, the person told me to check this blog. sucks…
November 3rd, 2010 11:47 pm
This is Mission Critical. Please fix now.
November 3rd, 2010 11:47 pm
Seriously a power problem… I thought you guys have UPS and generators well you are supposed to, anyhow this is retarded. If it was just my server borking O.K … but a whole DC or rack … whatever it is this is completely unacceptable. FIX IT NOW
November 3rd, 2010 11:47 pm
What the heck man, this is tooo freaken much. I am so devastated!!!!!!!!!!!!
November 3rd, 2010 11:48 pm
I don’t work for iWeb but seriously guys… stuff breaks sometimes. I’ve been a sysadmin for 10 years now, and even with UPS battery backups things don’t always go as planned. I’m happy to say we have had 0 outages until just today and I have been a customer for about 1 year now.
November 3rd, 2010 11:48 pm
wtf? this is not good, you better fix up your company real quick before you some some big customers!
November 3rd, 2010 11:48 pm
@Matt: We monitor our server every 3 minutes since 2 years ago. This is the first outage we see with this server. iWeb network/power has been solid overall, but this is concerning for sure. Seems like a back-bone power unit is down and the UPSs unable to take over (just a guess).
For those who say mission critical, u don’t run mission critical in one DC.
November 3rd, 2010 11:48 pm
Please MOVE US TO A NEW SEGMENT !!!!!!!!!
I do manage hundreds of websites and realtime application… did choose iweb instead of maintaining hundreds of singles small servers… maybe i shouldn’t have!
November 3rd, 2010 11:48 pm
How can a production site have no back, quiting asap.
November 3rd, 2010 11:50 pm
Can’t get a hold of anyone – thank goodness for twitter – that’s how I found this.
November 3rd, 2010 11:50 pm
Please confirm there is no FIRE involved!
November 3rd, 2010 11:51 pm
Are you not supposed to have three different electrical source? This is what the vendor told me. I can bring you my small generator if you need. Almost an hour now…
November 3rd, 2010 11:52 pm
According to your “written terms and guarantees”:
100% Network and Power Uptime
With a fully redundant network and leading edge hosting infrastructures, iWeb can guarantee 100% Network and Power Uptime with above average SLA credits in case of failure to deliver the stated level of service.
November 3rd, 2010 11:52 pm
Two major incident in two months is unacceptable. I knew I should have gone for a dedicated server…
Seriously iWeb shared service are fairly unsatisfying .
I’m not renewing…
November 3rd, 2010 11:53 pm
I loose money to every minute, iweb fix NOW !!!!!!! wheres the serious datacenter here?
its this iweb its a fake company?????????????? i dont know how iweb payment back the money and credibility that i loose it for this… very angry for this !!
November 3rd, 2010 11:53 pm
So do we get a refund?
November 3rd, 2010 11:53 pm
This is the second outage we have seen in 2 months time. Our customers do not appreciate this and we have no choice but to change hosting companies, very unfortunate :(
November 3rd, 2010 11:54 pm
i’m on a dedicated… and won’t help me much more….
November 3rd, 2010 11:54 pm
Seriously guys, if this goes for more my sad ass will be sued tomorrow. I pay you guys tons of thousands of $$$ for 100% uptime and that what i get!!!!!!!!!!!!!!
November 3rd, 2010 11:54 pm
I really hope this gets fixed quickly!!!!
November 3rd, 2010 11:54 pm
WOW just spoke to support and it seems the whole DC is down I want my MONEY BACK … not for a day or two but for the whole month otherwise i will but parking my clients elsewhere … I have been a client here for over 4 years and this is the second issue and the first was barely resolved so they better make good on this one.
November 3rd, 2010 11:55 pm
Olivier… dedicated servers are affected too.
Les serveurs dédiés sont affectés aussi.
November 3rd, 2010 11:55 pm
We gave 2 dedicated servers with iWEB, one we got about a year ago the other a couple months ago, the latter is down due to this outage. So dedicated servers are affected just the same.
November 3rd, 2010 11:55 pm
Have been calling and got busy tones and now has been waiting for the past 15 minutes. No answers. But did get some emails. Concur with some comments: how can iweb not have a backup power?
November 3rd, 2010 11:55 pm
Damn… it will be so LONG!
November 3rd, 2010 11:55 pm
Can we get an ETA to have this fixed?
November 3rd, 2010 11:55 pm
I can’t wait to rebuild my 40gb databases :-) Please don’t worry about confirming if there is a fire just proceed to put it out :-)
Thank you.
November 3rd, 2010 11:55 pm
Also VERY BAD that it took over 30m of outage time before a posting here.
November 3rd, 2010 11:56 pm
server offline 30 minutes.
November 3rd, 2010 11:56 pm
Where is the REDUNDANCY????
We run e-commerce webportals, with over 1 thousand sales per hour overall!
WE ARE LOSING MONEY EVERY MINUTE!!
November 3rd, 2010 11:56 pm
Please give an ETA so I can go to bed.
November 3rd, 2010 11:57 pm
What’s with all the talk about a fire? Random person feeding the trolls or is there any actual indication of this?
November 3rd, 2010 11:57 pm
@Oliver Leduc – I have 2 dedicated servers down. You’re lucky you didn’t spend $500/mo for this crap.
November 3rd, 2010 11:57 pm
100% random
November 3rd, 2010 11:57 pm
I got this response from IWEB:
the city has forced us to shut the main power to our CL Datacenter. There will be information posted on our blog about this situation. Please go to http://blog.iweb.com for more information. We apologize about this issue and understand your concern. Is there anything else I can do for you today?
November 3rd, 2010 11:57 pm
I heard it was the really annoying customers calling in and overloading the customer support lines which led to this system failure. iWeb needs to stop giving out cheap deals because it leads to cheap customers that complain about every penny they spend. Cheap bastards.
November 3rd, 2010 11:57 pm
Thank you for the idea Joseph…
just started my 500 gig transfert at the moment!
November 3rd, 2010 11:58 pm
WHAT!
November 3rd, 2010 11:58 pm
Nice thing I’m bluiding my backup infra at Canix…. hummm how about building my main infra there????
November 3rd, 2010 11:58 pm
Before today it was 99.99% uptime:
http://customer.uptimeinspector.com/remote/uptime.php?ref=REF-000013-4&id=241&id3=1cf158&id2=4&id4=4
I just want to know whether the issue can be solved (e.g. my server is not eaten by fire).
November 3rd, 2010 11:58 pm
I’m down too, according to the guy on live chat they need the authorities to fix this, whatever that means.
November 3rd, 2010 11:58 pm
Is it true that the montreal local tv stations are reporting a fire?
November 3rd, 2010 11:58 pm
Hahahhahahaha calm down guys …. you guys are not the only one who losing money every sec.
November 3rd, 2010 11:58 pm
Finally got a hold of someone – they said they had to shut down the power for safety reasons and that they are still investigating what caused it.
November 3rd, 2010 11:59 pm
According to your written terms and guarantees:
“100% Network and Power Uptime
With a fully redundant network and leading edge hosting infrastructures, iWeb can guarantee 100% Network and Power Uptime with above average SLA credits in case of failure to deliver the stated level of service.”
Yeah right!
November 3rd, 2010 11:59 pm
yeah, def, my tech (sysrenan) just got a big promotion of high-end servers, and I will be moving my servers this weekend as well with him…
I really hope this isn’t fire related!
November 3rd, 2010 11:59 pm
how long the server will be offline?
November 3rd, 2010 11:59 pm
Runbabyrun is this because of the fire :-)
November 3rd, 2010 11:59 pm
Very bad service, we have not been warned before this problem happens, and go over 30 minutes with the server offline, try to communicate via chat to know what happens but does not work, I think iweb we have to give a Explanation.
November 3rd, 2010 11:59 pm
Not happy Iweb – Why are we not getting communication from admin?
November 3rd, 2010 11:59 pm
No but we need answer for our angry customers!
November 3rd, 2010 11:59 pm
All servers down. What’s going on
November 4th, 2010 12:00 am
@Guillaume & Mathieu
Obviously I wasn’t thinkg about iweb’s dedicated server service… Why would I even consider renting a server with a company I don’t trust?
As soon as I can backup all my client’s data I’m renting a box at OVH.
November 4th, 2010 12:00 am
oh and thanks for the countless hours I’ll be spending restarting everything including my 20K$ SAN plugged on 2X 240 volts @500$ a month circuits for redundancy… oh yeah… all down…
November 4th, 2010 12:00 am
This is why I moving to other provider. I been them for 2 years but I have terrible experience aside from power problem, when most of my 4 servers experience hard disk failure and lost most of my clients data.
This company doesn’t care with their customer.
How in the hell in this world that a data center doesn’t have a power backup? are you host our server in your home?
November 4th, 2010 12:01 am
The folks at iWeb are technically challenged which is why I built a redundant architecture using more than one provider. If anyone is interested in guaranteed up-time, Feel free to contact me at brian@genuinecast.net. I’m in the BBB even if iWeb isn’t.
November 4th, 2010 12:01 am
This is the second time I’ve a issue with IWeb in 2months, I’ll get a month refund and I’ll get a serious discussion with the account manager !I’m not satisfy !
November 4th, 2010 12:01 am
What happened to all the claimed redundancy? Of all things, a power failure?! One of the easiest things to prevent with the proper architecture and planning.
November 4th, 2010 12:01 am
Not a clue Joe. I am trying to get to the root of it. I have 20 dedicated servers none of them up
November 4th, 2010 12:02 am
I have 40 servers down for more then 1hour. No responce on phone or live chat. Are you serious?
and it’s not first issue.
looking for another hosting provider
November 4th, 2010 12:02 am
Nobody gives the face in iweb, now what happened, this is uncomfortable, and are more than 40 minutes out of line.
November 4th, 2010 12:02 am
Up now
November 4th, 2010 12:02 am
WOW, im soooo moving my servers, OVER 60 MINUTES!!
O V E R 6 0 M I N U T E S O F D O W N T I M E
November 4th, 2010 12:02 am
How much time it may take to resolve this issue ?
i really desperate .. with this issue
November 4th, 2010 12:02 am
Hey everyone, I’m in the same boat: I have a dedicated server with iWeb which is down. A lot of you are furious, and I would be, too, were I ‘losing money by the minute’. But since my server is not yet mission-critical, I can come at this from a place of understanding: Even Google goes down sometimes. Remember when all of gmail was out for a while?
November 4th, 2010 12:02 am
Do you think they got doggy bag for taking out your HD?
November 4th, 2010 12:02 am
Yes backup. :) not great though down for about 1 hour.
November 4th, 2010 12:02 am
Well shit happens. In the past they have always been very helpful. This is the first time in 2 years something like this happens. I have two dedicated servers and both of them are not available. Not fun. This is the answer of live chat
the city has forced us to shut the main power to our CL Datacenter. There will be information posted on our blog about this situation. Please go to http://blog.iweb.com for more information. We apologize about this issue and understand your concern. Is there anything else I can do for you today?
November 4th, 2010 12:03 am
@ Itoldyou … oh yea real cheap i run $150 a month on a server i could host at work on a 50 mbit for free but then again i wouldn’t have redundant power and all these goodies that i pay for to have it hosted at IWEB. whatever if i’m cheap then but to me 150 dollars is money none the less. In fact now that i think about it … i might just setup server at work :P
November 4th, 2010 12:03 am
/”
|./|
| |
| |
|>~
November 4th, 2010 12:03 am
I’m not up.
November 4th, 2010 12:03 am
We are trying to get you as many informations as possible as fast as possible. I’ll also try to answer your comments as fast as possible. Sorry again about what’s happening.
November 4th, 2010 12:03 am
http://montreal.ctv.ca/servlet/an/local/CTVNews/20101103/mtl_blaze_101102/20101103/?hub=MontrealHome
November 4th, 2010 12:03 am
relax please. iweb is quality network. Yes, we’re using money but i know iweb’s support and dc quality. They’ll fix this problem urgently. This is first problem with me since 3 years.
November 4th, 2010 12:03 am
Some of mine are back online now.
November 4th, 2010 12:03 am
been on the on hold for 30minutes now, and on chat for 30 minutes. Any explenation. My clients are abusing me.
Some one just picked up the phone and told me that there has been a major fire next to the dtacenter. Servers are not affected. every thing is under control…
November 4th, 2010 12:03 am
We do business around the world and we can’t afford to have the following notice thrown around!
“Start: ~11:00PM EDT
Estimated time of resolution: N/A”
November 4th, 2010 12:03 am
If right now I’m looking for another provider, the service is very bad communication is difficult.
November 4th, 2010 12:04 am
yeah , …
miraculous … the issue solved , my server up now ….!
November 4th, 2010 12:04 am
This is to confirm that my dedicated server is back up now.
November 4th, 2010 12:04 am
Get this datacenter back up!!!
November 4th, 2010 12:04 am
@Minds: I can assure you iWeb has backup generators, I live close to Montreal and have visited both their HD and CL DCs. But I think they have more of a major issue than a backup generator.
November 4th, 2010 12:04 am
it’s up now
November 4th, 2010 12:04 am
Server still not up.
November 4th, 2010 12:05 am
my dedicated server appears to be up now, too.
November 4th, 2010 12:05 am
still down
November 4th, 2010 12:05 am
Good news! The power is back. All system are back online. We are sorry for the inconvenience.
November 4th, 2010 12:05 am
One server is up again. Now the other one.
November 4th, 2010 12:05 am
I dont care what their issue is, places like “ThePlanet” and “ServerBeach” dont have these issues.
November 4th, 2010 12:05 am
Realmente estoy preocupado recientemente cambie un server con sitios critios para nuestro negocio y en este momento no esta disponible y me es imposible hablar con ustedes por algun medio, espero que el problema se resuelva lo mas pronto posible!!
November 4th, 2010 12:05 am
DAM!!!, WHY, EVERY TIME THAT THIS HAPPENS!?? EACH MONTH? EACH WEEK? WHAT HAPPEN!!! MY CUSTOMERS ARE FURIOS AND ME TOO DAM, I AM LOSING MONEY AND CUSTOMERS!! AND Lweb LL LOSE A COSTOMER TOO…
November 4th, 2010 12:05 am
I was able to talk to someone and the City has made them shut off the power due to issues in the vicinity of the DC. This is the first time that we have had an issue with our dedicated server in the DC. It is costly because they do not know when they will be allowed to reapply power to the center but when the municipality tells you to shut down, you shut down. This is why we should all have a redundant server at a different center. I will be looking at implementing neverfail in the near future to prevent this issue.
November 4th, 2010 12:05 am
OMG BACK UP NOW YAY … NOW PAY ME
November 4th, 2010 12:06 am
Come to think of it, one hour isn’t that bad.
November 4th, 2010 12:06 am
3 of my servers are still down. This is not good…. including my backup server.
November 4th, 2010 12:06 am
My site is up. That’s all I care about. The rest of you can STFU.
November 4th, 2010 12:06 am
I might have something to do with the fire… I knew that my last SQL query was very very hot! Didn’t know it was going to burn my server though :)
November 4th, 2010 12:06 am
Exactly. My 2 servers are still down.
November 4th, 2010 12:06 am
Thanks, OlivierL. We appreciate your hard work, as I’m sure this must have been quite a stressful.
November 4th, 2010 12:06 am
We will post you the full details of what happened shortly. Thanks for your patience!
November 4th, 2010 12:07 am
OMG!!!! ALL THE DATACENTER IS DOWN!!!!!!!! Resolve this problem asap!!!!!!
November 4th, 2010 12:07 am
whom should i send a invoice for this inconvenience. had to wakeup from sleep
November 4th, 2010 12:07 am
I have more than 25 server’s in iweb datacenter. My 80% server down. plz tell how long time you need to up.
November 4th, 2010 12:08 am
Many servers should be up and running now. Power is back online. We are still working to give you informations quickly.
November 4th, 2010 12:08 am
this is the worst, my all sites go down almost daily with iweb. ;(
November 4th, 2010 12:08 am
Oliver, don’t tell people that the servers are back up when they aren’t.
November 4th, 2010 12:08 am
Olá, qual a previsão de retorno do datacenter?
Obrigado e aguardo vocês.
November 4th, 2010 12:08 am
only CL data center is still down… just spoke to somebody!
November 4th, 2010 12:09 am
Of our 7 servers in CL 3 went down – two are still down. :(
November 4th, 2010 12:09 am
Quote
“this is the worst, my all sites go down almost daily with iweb. ;( ”
this can’t be true
November 4th, 2010 12:09 am
Working Fine Now ! Next time Please tell to all Customer before any maintance
November 4th, 2010 12:10 am
My servers are now up!… I will change my principal server to our datacenter in Ecuador!.
November 4th, 2010 12:10 am
Great work all Back up now
Thanks Iweb now just close the accoutns of these idiots who bitch and moan cos their 2bit websites cant be seen by their 2 members
November 4th, 2010 12:10 am
Server is back but network is slow as hell, guessing it’s completely congested.
November 4th, 2010 12:10 am
“only CL data center is still down… just spoke to somebody!”
yeah, and guess wath… my server is right there!
November 4th, 2010 12:10 am
I think you guys should say more bad word it will help resolve the problem. Don’t you think iWeb has a good reason !!!! Wow get a life…. I’d like to see it happen to you and how you’ll manage this situation. We own 4 dedicated server and everything is down right now but saying bad word and complaining won’t help…. so calm down …. reta***.
Thanks
November 4th, 2010 12:11 am
Can someone reboot my server: CL-T074-264CL But first go into the bios and make it so I can use the remote reboot, it doesn’t come back up on its own and last time we talked someone said it was a bios setting.
November 4th, 2010 12:11 am
RESOLVED! ;-)
You people exaggerate a little bit! I have more than 40 websites here, and – believe me – situations like this one happens EVERYWHERE! I migrate since 1996 with my websites around the world (also Europe) and saw my websites disappearing sometimes for 3 long days! Here at least the staff doesn’t lie! ;-) And we have the blog – ACCESSIBLE – where we can exchange some information about the issue! ;-)
November 4th, 2010 12:11 am
Please take note that we are currently experiencing an higher than normal call volume due to a power distribution issue at our iWeb-CL datacentre. Thank you for your understanding.
November 4th, 2010 12:12 am
Vous ne pouvez vous imaginer le tort que cela cause à ma petite entreprise !
Comment vais-je redresser ce tort ??????? C’est en cette période que mon lectorat visite le site pour lire notre magzine mensuel !
November 4th, 2010 12:13 am
Hello, what is the estimated return of the datacenter?
Thanks and I await you.
November 4th, 2010 12:13 am
Thank you guys (Olivier and Sylvain) and indeed just dump those guys who are bitching all the time. This isn’t really helpful.
November 4th, 2010 12:13 am
Everything is up again. Wonderful. Only one hour and a half
November 4th, 2010 12:13 am
I want a refund. I have several clients on my server and they are ALL mad at us.
Iweb, what do u have to say ?
November 4th, 2010 12:14 am
Can you please give us a rough estimate of when the servers will be back up. I’ve been plugged in for 6 hours making good progress to have my servers crap out. Really annoying.
November 4th, 2010 12:15 am
Sorry, I just lost thousands of dollars and credibility. I am not happy.
November 4th, 2010 12:16 am
Calm down, cryfags.
November 4th, 2010 12:17 am
up now
November 4th, 2010 12:17 am
@El Fouladi; si votre serveur n’est toujours pas accessible, svp, contacter notre service technique, ils interviendront rapidement pour le rendre disponible.
November 4th, 2010 12:17 am
@Jee….
if you were loosing thousans of bucks every hour and paying employee just to wait that someone at Hydro-Q will do is job maybe you would complain!
November 4th, 2010 12:18 am
@luiz tarabal Datacenter is now back online. If your server is not, please contact our customer support.
November 4th, 2010 12:19 am
time to start planning my own redundancy
November 4th, 2010 12:19 am
Lee ans Henry …u probably have no business to run, other than just ur mickey mouse personal website eh?
November 4th, 2010 12:19 am
@Rich
good idea….
November 4th, 2010 12:19 am
Olivier, si t’as perdu des milliers de $$$ en 1 heure, je suis un peu jaloux de toi. :-)
November 4th, 2010 12:20 am
Although there was downtime, this is a good example of support. I have been in other providers and there was not a channel like this one to inform what was happening. At least here I could learn that I was not alone and that iweb was fixing the problem.
Don’t say it doesn’t happen in other providers. It will always happen, everywhere. Get used to it.
November 4th, 2010 12:20 am
I just lost about fifteen million dollars myself in this debacle, but there’s a positive point : I just saved a lot of money on my car insurance by switching to Geico.
November 4th, 2010 12:20 am
@Not Happy; we do offer satisfaction guaranty that you can ask for in your customer hub.
November 4th, 2010 12:21 am
@Andrew; Your server should now be back online. If not, please contact our customer support.
November 4th, 2010 12:21 am
@ Mathieu Tremblay … I still love the doggy bag idea :P
November 4th, 2010 12:21 am
I have a business to run, but my customers are in Holland. So they are asleep :-) Nevertheless they have always been pretty patient when things went wrong at the other datacentre and over there things really went wrong.
November 4th, 2010 12:22 am
Oh you are all such drama queens… The tech support and cust service are trying their best ! What? Are you gonna die or something ? Take all a chill pill and relax. There are much more harder things in life… Peu-lease.
November 4th, 2010 12:22 am
this was longest downtime I experienced at iweb in 1 year
November 4th, 2010 12:22 am
Our server isn’t online! How long should it take? Looks like others is online now..
November 4th, 2010 12:23 am
And is more than an hour without service, converse via chat and gave me no coherent explanation, I suggest that soon will be online but is a long time, now I say when this will happen again, should take all necessary safety measures prevent these things.
November 4th, 2010 12:23 am
@Jee
you mean by going bankrupt!
November 4th, 2010 12:23 am
I was a few days behind on my payment and thought they shut me down…. i jumped up and paid, and then hit support to find that the system is down and my dedicated server is among them….. im actually happy!
sure, im losing a bit of business right now, but these things happen… no big deal as long as it doesnt go on for any true long term.
relax peeps… shit happens.
November 4th, 2010 12:24 am
Great news..thanks.
November 4th, 2010 12:24 am
FUCK MY SERVER, I LOST MY DATAAAAAAAAA
November 4th, 2010 12:25 am
please change at least your 100% uptime slogan to
almost online all the time…
November 4th, 2010 12:25 am
@Louise Gaga…if this is not important to you…u should go to bed.
November 4th, 2010 12:25 am
@Jawa; Please contact our customer support and give them your server ID, they will look into it. Most servers are now back online, but some might need a manual intervention.
November 4th, 2010 12:25 am
Unacceptable situation, putting a lot of efforts finding another dc.
Another customer lost, I fed up.
After a desastrous migration from Plesk to Plesk, this outage is not
welcomed.
Je vous quitte IWeb, je ne suis plus capable de perdre ma crédibilité
à cause de vous. C’est pas fort les gars, vraiment vraiment pas fort.
November 4th, 2010 12:25 am
What little money I have left now, I’m investing in Cryfags’ BUTTHURT AFTERSHAVE(tm)… ’cause it sure smells like that musk in here.
November 4th, 2010 12:26 am
@Sylvain
Well, it doesn’t seem that all servers are up. Our 3 main servers went down and ARE STILL DOWN!
November 4th, 2010 12:28 am
im still down too!
November 4th, 2010 12:28 am
Thank you iWeb for good communications. I would recommend though that you also add an automated status message on your phone line instead of waiting or getting busy signal. But it is given, there can’t be enough people to answer all the calls for such an outage.
I also hope you find the cause of this issue and proactively prevent it from happening in teh future. Even with weekly generator tests, issues happen out of the blue. Technology is just unpredictable.
To those who have their servers still down, check your APC Remote Reboot and make sure your port is turned on. It seems some ports reset to Offline afer the outage.
November 4th, 2010 12:28 am
Can someone reboot my server: CL-T074-264CL But first go into the bios and make it so I can use the remote reboot, it doesn’t come back up on its own and last time we talked someone said it was a bios setting.
November 4th, 2010 12:29 am
Hello
Our server is still down.Please do needfull
November 4th, 2010 12:29 am
Server Still down !! more than 1.5 hours now!
grrr
November 4th, 2010 12:29 am
Im not able to access my servers still.
November 4th, 2010 12:30 am
@lui; please contact customer support to see what can be done.
November 4th, 2010 12:30 am
i will have a crazy thursday!
November 4th, 2010 12:30 am
Sylvain, they said that all servers are not back up yet.
November 4th, 2010 12:30 am
To people who still have a downed server : have you tried turning it off and on again?
November 4th, 2010 12:31 am
I would just like to reverse a log of the slander above and CONGRATULATE
November 4th, 2010 12:31 am
My servers are still down & customer service is telling me to wait. This problem is still not fixed
November 4th, 2010 12:31 am
@SH; Power is back online in the DC. We still have some switch that needs manuel interventions so your server might be on those switchs. Please contact customer support, the will look into it as fast as possible.
November 4th, 2010 12:32 am
iWeb on 2yrs of great service. Only 18 mins server centre downtime before today, well done. Much better than other services i have had in the past. I won’t be moving even though over 600 of my clients just went offline….
November 4th, 2010 12:32 am
Hi Guys. Are customer support are online and ready to help you if you still have some problems. Please contact us if you have problems. Thanks
November 4th, 2010 12:33 am
@Edwin & Emil
Yep, the same situation here. It’s a 90-min.- outage for our 3 mainstream servers. Hopefully this didn’t affect data on our servers!
November 4th, 2010 12:33 am
SRSLY, if everyone here claiming to loose thousands of bucks a minute were real, we would have the largest GDP in the world. Also, if some of you tards wants 100% uptime, why not properly host redundant servers in 2 or more datacenters. If you are loosing thousands a minute, what the hell are your servers doing in a single datacenter?
iWeb is certainly not perfect, but they always got our stuff fixed (7 years we’re customers there, hosting more than 2000 customers, some very corporate ones). Only ONE customer actually sent us a ticket for that issue tonight. It happened VERY rarely in the last 7 years. Of course, having your service down is not fun, but there’s no use pissing vinegar.
Seriously, this outage was priceless just for reading that thread. I declare it epic win.
November 4th, 2010 12:34 am
@Andrew; unfortunately you are right. As I said to SH, there is still some switchs that needs manual interventions. Many staff are onsite to get all servers back online as fast as possible.
November 4th, 2010 12:35 am
@Some customer
we are writing just for the show!
November 4th, 2010 12:36 am
Mine (dedicated) is up and running now. Had to restart everything manually in the good sequence but I’m back in business. Good luck with all the PS replacement….
November 4th, 2010 12:38 am
Can someone please tell me if my interweb tubesite http://www.grandpapajorgenscatfancyeshoponline.com is back up and operating? I’m literally loosing hundreds of millions of kroners per SECOND.
November 4th, 2010 12:38 am
@Sylvain
We have already spoken with someone from the support and opened a ticked … we wait for someone to do fck …
November 4th, 2010 12:41 am
@Jee
still down… mine too!
November 4th, 2010 12:41 am
At least they are now responding to their phone !
They just told me it shouldn’t be very long…
November 4th, 2010 12:42 am
We are still down on two of them as well.
November 4th, 2010 12:44 am
I really don’t like those night!
November 4th, 2010 12:44 am
me too, still down
November 4th, 2010 12:46 am
Note: If your servers are not back online yet, you might want to try to turn it OFF and ON again using your APC remote reboot port in your customers hub.
November 4th, 2010 12:49 am
still wont work after reboot!
November 4th, 2010 12:49 am
same here
November 4th, 2010 12:49 am
Has anyone really been far as decided to use even go want to do look more like?
November 4th, 2010 12:50 am
To all flamers: I believe the problem is not an uptime/redundancy issue. If you want to prevent this kind of outage to your servers, look for a provider who advertises “we do not follow instructions from government and other people in authority”.
November 4th, 2010 12:51 am
@Mathieu; If you have opened a ticket in the customer hub, can you please give me your ticket #?
November 4th, 2010 12:51 am
You guys need to chill the fuck out. There was a fire. You can’t do anything about that. iWeb’s doing the best that they can. Chill out.
How would you feel if your house burned down and everybody bitched at you for not being able to have them over for dinner?
November 4th, 2010 12:51 am
Still doesn’t work.
November 4th, 2010 12:52 am
@Farmer:
Ha!
Haters should host their shit somewhere in Somalia. I hear they’re not too keen on government intervention over there.
November 4th, 2010 12:53 am
dont have any ticket open yet!
November 4th, 2010 12:53 am
@Sylavain here is my ticket if you want to manually reboot ours – RQ #3804965
Thanks in advance.
November 4th, 2010 12:53 am
Sylvain please help me.
My ticket is TICKET #3804795
Thx.
November 4th, 2010 12:54 am
ticket #3805703
did APC reboot
server still unreachable
November 4th, 2010 12:55 am
@ Sylvain
Ticket Number- #3806622
November 4th, 2010 12:55 am
Arguing about uptime is pointless. iWeb is well aware that if their uptime is not good, it will cost them their business. Downtime is a part of hosting a web site. I will admit that iWeb has had some unusually difficult uptime issues recently, but I also note that iWeb does far better at communication than any other host I’ve used, and that they do seem to learn from their mistakes. So yeah this was a serious outage and iWeb badly needs to figure out why their backup power systems failed (an unacceptable thing), but in general iWeb is one of the good hosters. Keep a little perspective.
November 4th, 2010 12:56 am
Sylvain, please help me. I’m a Nigerian prince and I have this huge inheritance that i need to move out of the country. I just need your bank and credit card information.
November 4th, 2010 12:56 am
@Sylvain… peux-tu vérifier le status de mon billet svp. #3806539 Merci.
November 4th, 2010 12:56 am
@Jee…………….get lost!
November 4th, 2010 12:56 am
@Jee
message directly the prime minister… he will help you with this!
November 4th, 2010 12:58 am
Dominic is sleeping on the chat… still waiting for him to get up…
do you know at which time he usually wake up?
November 4th, 2010 12:59 am
Those who gave me there ticket number, I look into it right away.
November 4th, 2010 1:00 am
hub interface works very strange
CSS doesn’t seems to work!
November 4th, 2010 1:00 am
@Not Happy: u mad?
@Mathieu : Surement pas, j’ai pas voté pour lui.
November 4th, 2010 1:01 am
@Sylvain
We tried the APC Reboot, but nothing happened. One of our servers is down for 3 and another 2 for 2 hours so far.
Here are our tickets, so please do your best to make them accessible:
#3806383
#3806334
#3806282
November 4th, 2010 1:03 am
@Sylvain
We are trying the APC Reboot, but doesn’t seem to be working.
Ticket number #3806524
Thanks!
November 4th, 2010 1:03 am
My dedicated server was affected by the outage, everything is fine now. I have access to my websites on the internet, FTP connexion too.
BUT, I don’t have access to my Plesk Panel… it says “can’t establish a connection”.
November 4th, 2010 1:04 am
@SH; I’ll look into it now.
November 4th, 2010 1:05 am
Mail services on S035 aren’t working yet. What’s happening?
November 4th, 2010 1:06 am
@sylvain…
3806714
November 4th, 2010 1:07 am
@Anton; I’ll have someone on it as fast as possible.
November 4th, 2010 1:08 am
(Sorry to repeat… forgot to add the Ticket Number :#3806769)
My dedicated server was affected by the outage, everything is fine now. I have access to my websites on the internet, FTP connexion too.
BUT, I don’t have access to my Plesk Panel… it says “can’t establish a connection”.
November 4th, 2010 1:08 am
@Sylvain
My TICKET is #3804795
Thx.
November 4th, 2010 1:09 am
@Mathieu; I’ll have someone to work on it.
November 4th, 2010 1:09 am
Ok, everything got back to normal for us. All servers are up. I hope this situation won’t happen again.
November 4th, 2010 1:09 am
Dominic just told me to use the opinions/comments form to resolve my issue!
November 4th, 2010 1:09 am
@Sylvain, peux-tu au moins me dire le statut de mon billet? #3806539 Merci.
November 4th, 2010 1:10 am
Hope he doesn’t answer like that all the time!
November 4th, 2010 1:11 am
Server still not up
ticket #3805361
Cheers
November 4th, 2010 1:11 am
todavia no abre el site. y dice Database Error: Unable to connect to the database:Could not connect to MySQL
November 4th, 2010 1:12 am
I appreciate your support Sylvain.
November 4th, 2010 1:12 am
Hi Sylvain,
My ticket number: 3806575
I did remote reboot. but its not come to online. plz check it. its very urgents
November 4th, 2010 1:12 am
TICKET #3806559
November 4th, 2010 1:12 am
3806383; server should now be up and running
November 4th, 2010 1:12 am
@Daniel:
Cool story, bro.
November 4th, 2010 1:13 am
3806334; server should now be up and running
November 4th, 2010 1:13 am
TICKET #3806278
November 4th, 2010 1:13 am
3806282; should now be up and running
November 4th, 2010 1:13 am
please check RQ3806692
November 4th, 2010 1:14 am
3806622; Should now be up and running
November 4th, 2010 1:14 am
What’s with all of the losers on these forums posting just random B.S? People like Jee and others really need to find something better to do on their wednesday evening.
November 4th, 2010 1:14 am
ticket 3806650
November 4th, 2010 1:17 am
@Steve…
so don’t loose your time here writing things nobody cares!
November 4th, 2010 1:17 am
Please check on CL-T074-352CL
November 4th, 2010 1:17 am
@Sylvain
3806622 still isn’t running. Please try again. Thanks.
November 4th, 2010 1:18 am
@Sylvian
Thanks … An update … It seems yet another our server is still down, please check this ticket ID:
#3806863
November 4th, 2010 1:18 am
@Alex, @conlince, @Stanton li, @Ryan, @Ajay; I have all your request # and I can confirm that someone is working on it now.
November 4th, 2010 1:20 am
@Steve
For someone is now an evening, but for someone is dawn or middle of the night :S
November 4th, 2010 1:20 am
Please, see ticket #3806705
November 4th, 2010 1:20 am
#3806480
November 4th, 2010 1:20 am
@Andrew; sorry, my mistake. Support told me they gave you an answer, but server is not up yet… they are still working on it.
November 4th, 2010 1:20 am
i never saw this before!
November 4th, 2010 1:21 am
Server: CL-T078-011CL
Ticket #: 3806542
APC reboot did not work.
November 4th, 2010 1:22 am
@Steve:
I’m an iWeb customer. I’m actually taking a positive, goof-off attitude towards this problem, which I can’t do shit about. My other option is to whine like a bitch, as others have been wont to do in here. I’ll have just as much work to do tomorrow as you guys will have, and like you, I’m looking forward to going to bed. You are not a beautiful and unique snowflake. Chill.
November 4th, 2010 1:25 am
@Sundeep; I’ll ask someone to verify.
@Jawa; can you give me a request number please?
@SH: I’ll ask someone to verify
@Julio; I’ll ask someone to work on it.
November 4th, 2010 1:25 am
@Sylvain: #3806480
Thank you
November 4th, 2010 1:26 am
Yes Proceed
November 4th, 2010 1:27 am
@Sylvian
Any news about this one: #3806863? It’s very important for us since we cannot run our mainstream website until this server is down, so please assign someone on this ASAP!
November 4th, 2010 1:27 am
@Sylvain,..
i need at least 15 minutes to rebuild up all my setup and by 2h15 i wont be able to avoid a major system failure on several on my customers
this will make me lose a lot of ressource for the rest of the week!
Is there anything to do to be up faster?
November 4th, 2010 1:28 am
@Sylvain any news on the #3806539
November 4th, 2010 1:28 am
Server: CL-T204-080CL
Ticket #: 3804795
APC ON/OFF did not work.
Thx.
November 4th, 2010 1:30 am
My half-rack at CL with 21 servers is still humming along…no power loss…had no problems for almost a year now….
My 2nd dns server (leased at CL) was offline for about 5 mins tonight…no big deal…that’s what I have 2, in separate locations….
I’m still a happy iWeb client….
Richard D
November 4th, 2010 1:31 am
Merci!
November 4th, 2010 1:31 am
Server ID CL-T217-010CN
November 4th, 2010 1:32 am
Note: I’m not onsite and many servers can only be accessible onsite or after a KVM/IP have been connect to the servers. There is many staff onsite and running around to get everything back online. I’m in direct contact with the staff who are working on the request number you’re giving me. Thanks for your patience, I do understand your situation.
November 4th, 2010 1:32 am
3806863; should now be back online
November 4th, 2010 1:33 am
I’m back up. Thanks for resolving this quickly.
November 4th, 2010 1:34 am
3806705; should be back online
November 4th, 2010 1:34 am
Please, see ticket #3807009
November 4th, 2010 1:34 am
@Sylvain Could you please give a check to #3806366, it’s the only machine still down after the outage. Thanks a lot.
November 4th, 2010 1:35 am
3806711; should be back online
November 4th, 2010 1:36 am
Both my linux dedicated and windows dedicated are down, please advise!!!
Company 4422031 canada inc
November 4th, 2010 1:36 am
@Mathieu; I understand. Let me see what I can do. I’ll do my best.
November 4th, 2010 1:41 am
cl-t162-520cl.privatedns.com down
November 4th, 2010 1:42 am
wt abt ticket 3806650
November 4th, 2010 1:42 am
Hi, my server is still down, please reboot. CL-T173-081CL
November 4th, 2010 1:44 am
@SH: Still working on “3806863″; this server is near next in line. I hope it will be back online soon.
November 4th, 2010 1:44 am
@Sylvain – One of our seven servers are still down please have a look at ticket RQ #3804965
November 4th, 2010 1:44 am
hello @Sylvain Its a online news portal reading more than 1 million per day
wt i answer to my client .plz answer me
ticket 3806650 Server ID CL-T217-010CN
November 4th, 2010 1:45 am
@SH: 3806863 should now be back online; can you confirm?
November 4th, 2010 1:45 am
Damn, I was hoping to get this resolved tonight. Another sleepless night=( Please update me when 3806622 is resolved.
Thanks for your support.
Andrew
November 4th, 2010 1:46 am
Our server is still offline. I’ve submitted a support ticket 3807094
November 4th, 2010 1:47 am
@Giovani: 3806539 is not online yet, but you should have received an update from our team. Still looking into it.
November 4th, 2010 1:47 am
@Sylvain
Thanks, we are back up. Thanks for your help and your efforts.
November 4th, 2010 1:48 am
@Sylvain..any news? #3806539
November 4th, 2010 1:48 am
Ok tx Sylvain!
November 4th, 2010 1:49 am
@Sylvain Any News for ticket 3806650
Server ID CL-T217-010CN
November 4th, 2010 1:54 am
@Gustavo, @Sundeep, @Julio, @Frank, @Nathan; I’ve noted your request numbers. We will look at it in the next minutes.
November 4th, 2010 1:54 am
@Sebastien, @Rodrigo; can you contact customer support and give me the request # please?
November 4th, 2010 1:54 am
@Sylvain, any news for 3806524?
November 4th, 2010 1:55 am
@Sylvain any update for TICKET #3806575
November 4th, 2010 1:55 am
@Sylvain could you note mine too please? #3806366
November 4th, 2010 1:57 am
Ok, thx Sylvain!
November 4th, 2010 1:58 am
My server is still down. I understand problems happen but I’ll have no choice but switch to other providers if it keeps happening.
November 4th, 2010 1:59 am
Recovering database from backup lost a days worth of data.
I had just fixed the MySQL cluster an hour before this and wanted to relax and sleep at a normal time tonight but now who knows when I will go to sleep.
I should be mad but I’m too tired.
PS: iWeb’s customer service has been horrible on many occasions.
November 4th, 2010 2:01 am
@Sylvain Nevermind, it’s all up and running. Thanks again for the help.
November 4th, 2010 2:01 am
Etes vous bien certain que ce n’est pas le grand méchant éceureuil qui est venu ronger des fils, de courant ce coup ci ?
November 4th, 2010 2:02 am
cl-r043-100cl :
root password no longer works after the power problem. How is this possible?
Technical team told me it could take 1 or 2 hours for using the single mode. We have xx xxx visits per day, we cannot wait :(
November 4th, 2010 2:07 am
im still wainting… hope you get clear of this soon!
November 4th, 2010 2:10 am
@Wilmar: Could you please contact the customer support and give me the ticket number?
November 4th, 2010 2:11 am
@Sylvain, You said people were working on my server 50 minutes ago, but I still haven’t heard anything (TICKET #3806278). Any updates? If its a bios issue, feel free to just get it running and we can fix that later.
Thanks
November 4th, 2010 2:11 am
OHhhhhhhhhhhhhhhhhh God i promiseed my client it will ok 10 min
but after that it one hour
November 4th, 2010 2:11 am
Hi,
We have hosted so many web sites and driving millions of traffics to all our sites. Because of the problem at your end, we lost lot of money. please fix it asap as it been more than 4 hrs our all sites went down.
Regards,
Lokesh
#68982
November 4th, 2010 2:12 am
Damn my deadline has passed by….
i will get so much trouble!
November 4th, 2010 2:13 am
@Sylvain, please put a rush on 3806524. Customers are not happy, to say the least.
November 4th, 2010 2:13 am
Sylvain, please help us : #3807287
November 4th, 2010 2:13 am
@Sundeep…
refer your client to god :)
November 4th, 2010 2:14 am
@iweb client: can you please give me your request number?
November 4th, 2010 2:17 am
@Mathieu : Sylvain told me someone is working on your server.
November 4th, 2010 2:19 am
thanks for the support!
i would only like to find more words to say to my customers!
November 4th, 2010 2:19 am
Since iweb told them that power was back they dont understand im not!
November 4th, 2010 2:19 am
please look into our ticket #3807178 and get it fixed asap. want to know how long it takes to fix the issue.
November 4th, 2010 2:20 am
Sylvain, please let me know status of: #3807094
Thank You, I really appreciate all of you hard work in this crisis
November 4th, 2010 2:22 am
Any update guys on #3807009 ticket?
November 4th, 2010 2:22 am
Ok, its up. Thanks for your help.
November 4th, 2010 2:23 am
@Ryan: Sorry for the delay. There is still a couple of hundred servers down. Some for hardware problems, some for software problems, some connected to switchs that can’t be rebooted. I’m still not sure what type of problem your server encounter but you should have receive updates from our customer support during the past 30 minutes and you will continue to receive feedback since i’m following the request you sent me. If you do not receive feedbacks and informations from our customer service, please let me know.
November 4th, 2010 2:26 am
@Mathieu; I’ve been told that your server is now rebooting with an FSCK. Shouldn’t be long now.
November 4th, 2010 2:26 am
Thank you Sylvain my server is up now
thanks iweb
November 4th, 2010 2:26 am
Thanks for the update sylvain!
November 4th, 2010 2:28 am
@Sundeep: 3806650: your server should now be back online. We have changed the Power Supply. Please confirm.
November 4th, 2010 2:28 am
If you have ever toured the iWeb facilities, you’d understand what they are up against. I’ve toured the CL data center in St. Leonard..and will be racking 46 more servers at CO downtown next month…
iWeb is impressive. There are far worse places to colo or rent a server…trust me.
1) There are litterally *thousands* of servers in CL. They are floor to ceiling in the rent-a-server area.
2) iWeb will ensure that this will never happen again. They don’t get big by repeating costly mistakes.They are a fairly intelligent bunch.
3) I’m an 8 hour drive from my server rack at the colo area of CL. They have been very fast reacting to problems ( PDU quit one time in my rack at 2:00 amand dropped 5 -6 servers) and they fixed it…Immediately.
4) For those complainers who claim to loose “thousands of dollars an hour/minute”, then maybe you can afford to create, and manage your own datacenter or at least get your own private rack ;)
Rickmeister
November 4th, 2010 2:30 am
@Mathieu: If you would need us to write something to explain to your customers what happened, please let me know.
November 4th, 2010 2:30 am
@Sylvain…………….#3806539 ………………???
November 4th, 2010 2:31 am
i’ll call my representative this morning….
November 4th, 2010 2:32 am
i just want to get up for now…. when i’ll be up i’ll try to find more answers
November 4th, 2010 2:32 am
@Sylvain – who is working on our ticket #3807178? what is the status?
November 4th, 2010 2:33 am
3805361 and 3806278 should now be back online.
November 4th, 2010 2:35 am
Server has been up for quite some time.
Websites are down due to no DNS working :(
November 4th, 2010 2:37 am
Nothing new after the technician told me he was going to create a request an hour ago for my server.
I recreated it with the number #3807287, I do not know if someone is seriously going to fix it because it seems far more complicated than a power issue. Root/ssh access no longer works (invalid password ??). How long would it take for someone to use the single mode?
5 years old customer…
November 4th, 2010 2:38 am
i never saw something similar to this in 5 years….
November 4th, 2010 2:39 am
@Giovanni: 3806539
@Lokesh: 3807178
@Julio: 3807009
@iweb client: 3807094
@Anton: 3806524
I confirm that I still have your request on my list of followup and our team still investigate your servers.
November 4th, 2010 2:40 am
3806542: your server should now be back online.
November 4th, 2010 2:43 am
still got no news since the fdsk was supposed started!
November 4th, 2010 2:43 am
Thanks, Sylvain! Here’s hoping it’s up soon.
November 4th, 2010 2:43 am
@Lokesh: 3807178: your server should now be back online. Please confirm.
November 4th, 2010 2:44 am
Sylvain, peux tu nous donner des informations sur #3807287. Nous sommes dans le flou total. Le problème a l’air bcp plus compliqué que l’électricité. On a perdu l’accès root depuis le problème électrique :(
November 4th, 2010 2:45 am
We’ve been with iWeb now into our sixth year only one other incident and that was about two years ago with a router that took a bunch of servers down for a few hours.
@Sylvain we have closed ticket 3804965 and now have 3804501 open.
This is so it does not cause confusion on which server is still down.
November 4th, 2010 2:45 am
@Anton: I confirm that one sysadmin is working on your cluster at this moment.
November 4th, 2010 2:46 am
It seems Human are not perfect! iweb team is trying its best to resolve the issue, I hope the problem is sorted out soon :-)
November 4th, 2010 2:47 am
Excellent, looks like we’re partially up.
November 4th, 2010 2:47 am
@Mathieu: Your server should now be back online. Please confirm.
November 4th, 2010 2:47 am
@Sylvain – yet our server is not up… all sites are down.
November 4th, 2010 2:49 am
still not able to ping it
November 4th, 2010 2:49 am
‘For those complainers who claim to loose “thousands of dollars an hour/minute”, then maybe you can afford to create, and manage your own datacenter or at least get your own private rack ;)’
Or Just try managed DNS http://www.dns.com this will insure your website is never down.
November 4th, 2010 2:50 am
Hello,
please look into our ticket 3807364
thank you in advanced
November 4th, 2010 2:54 am
all sites are down..
IP Address: 67.205.103.169
City: MONTREAL
ISP: IWEB DEDICATED CL
Latitude: 45.5
Longitude: -73.5830001831055
Country: CANADA
November 4th, 2010 2:56 am
@Sylvain, Any update on Ticket #3806634 ?
November 4th, 2010 2:59 am
@Sylvain – i am waiting for your reply. replied to my ticket #3807178 in iweb Technical Support section.
November 4th, 2010 3:00 am
Mon site semble fonctionner, mais les derniers changements on ne les voit plus, je crois que je les ai perdu! ?%&!!!
C’est possible de le recuperer? #3806539
November 4th, 2010 3:00 am
sylvain…
i cant even ping my server
November 4th, 2010 3:01 am
now i can… thank you dear!
November 4th, 2010 3:01 am
@iweb client : 3807287: Je vous confirme que votre demande est dans la liste de traitement. Je fait un suivi sur votre demande. Personnellement, je ne peux pas vous expliquer le problème de mot de passe, mais dès qu’un administrateur réseau se libère, il se branchera sur le serveur pour le reseter. Sincèrement désolé pour le délai.
November 4th, 2010 3:04 am
Our ticket is 3807598… Was able to connect to APC and reset it there, but that didn’t help. The server is still inaccessible.
November 4th, 2010 3:05 am
@Sylvain, is the sysadmin still working on the cluster or has he finished?
November 4th, 2010 3:08 am
#3807287
Quand je pense qu’on paye un KVM dédié sur ce serveur. Le mot de passe ne marche pas sur le KVM et l’assistance technique me dit que le serveur KVM est actuellement branché sur une machine windows alors qu’on est en linux. Donc le KVM Dédié est branché n’importe comment.
Je vous passe la fois où j’avais eu un KVM branché sur la machine d’un autre client.
(pétage de cable)
November 4th, 2010 3:10 am
A mounted partition in our server is empty after the incident. Ticket is 3807641. Partition is described on /etc/fstab
/dev/datavg/datavol /data ext3 defaults 0 0
But it is not being loaded anymore. It is a LVM partition.
Most services and info are in this partition
November 4th, 2010 3:12 am
Please someone take a look at ticket #3807430. Thanks.
November 4th, 2010 3:14 am
I must say as aggravated as I am over this issue and several others at this time with iweb, I do appreciated the fact you are communicating with your customers in some form or fashion. Thanks for your hard work and dedication even at the wee hours of the morning. Keep making us iweb customers proud/happy that we chose you. Having been with several hosting companies over the last several years, I have stuck with iweb for the last 5 years. Thanks again dedicated tech support staff for all that you do.
November 4th, 2010 3:15 am
@osh: could you please reply be email so the sys admin who will work on it can get all the right info? Thanks!
November 4th, 2010 3:15 am
@Anton: Yes. 3 servers up, 2 servers still down.
November 4th, 2010 3:19 am
@iweb client: 3807287 : Je ne peux pas commenter sur cette situation concernant le KVM. Pour l’instant, le plus important est de remettre le serveur en ligne et vous pourrez contacter votre directeur de compte demain (ou le service a la clientele) et nous reglerons la situation avec le KVM.
November 4th, 2010 3:19 am
@Sylvain – any updates on my ticket #3807178?
November 4th, 2010 3:21 am
@Giovanni: Je vois dans votre requete que votre serveur/site semble de retour; est-ce bien le cas?
November 4th, 2010 3:22 am
3806366: Your server should now be back online. Please confirm.
November 4th, 2010 3:26 am
@Sylvain – 3807094 – is back and running.
Thank you for your hard work and support.
November 4th, 2010 3:27 am
Everything is back now…
thank you again for your help!
November 4th, 2010 3:28 am
@Lokesh: 3807178: your site should now be back online.
November 4th, 2010 3:30 am
Merci de bien vouloir checker 3807781
November 4th, 2010 3:34 am
@Sylvain, Please check the tciket #3806634
November 4th, 2010 3:36 am
Please check #3807682 ! It’s over 9:00am here and customers are going mad!
November 4th, 2010 3:42 am
@Sylvain – all sites are loading fine. ticket #3807178 closed. please sure that everything is fine with our server. thank you for everything.
November 4th, 2010 3:43 am
@Lokesh: 3807178: Your sites should now be back online. Please confirm.
November 4th, 2010 3:44 am
Can you please check ticket 3807724? Merci
November 4th, 2010 3:48 am
Sylvain – TICKET #3807283 – can’t ping or access the server in anyway… please advise a time frame if this needs to be manually looked at.
thx/dom
November 4th, 2010 3:48 am
@Lokesh Thanks for the confirmation.
November 4th, 2010 3:50 am
Hi, please check ticket #3807578, my server is still down. Please this is very urgent. Many Thanks
November 4th, 2010 3:52 am
@Sebatian, @Jegan, @Dion @Emanuele; I confirm that I have your request number on my list of followup and our team still investigate your servers. I’ll give you feedback as fast as possible.
November 4th, 2010 3:52 am
APC not Reboot my Server
Pending ticket #3807083
Date : 2010-11-04 01:41:45 no Answer
Client #108982
November 4th, 2010 3:55 am
Could you also check ticket #3807598?
November 4th, 2010 3:57 am
Could you please check ticket 3807364
November 4th, 2010 3:59 am
@Ryan, @Roland, @Brett: I’ll followup on your request.
November 4th, 2010 4:01 am
@Hassan; Yes, I’ll add your request number to my follow up list.
November 4th, 2010 4:06 am
@Sylvain Remote reboot did not work… no ability to ping… I know everyone’s server is important,,, but I am in Thailand and it is 3:00 PM here not night….
Someone please advise asap… no response via hub, or email….
thx/dom
November 4th, 2010 4:07 am
@Sylvain – sorry to include ticket: TICKET #3807283
November 4th, 2010 4:08 am
Please check on the status of #3804501
Thanks
November 4th, 2010 4:10 am
Je n’ai pas osé poster avant car il ne reste que le LB2 qui est indisponible et je comprend très bien le volume de serveurs à régler, mais j’apprécierait au moins un acknowledgement nagios sur cl-t112-522cl car le message se repete et rempli ma boite. Merci.
November 4th, 2010 4:11 am
Ticket : 3807359
November 4th, 2010 4:16 am
@Domonic: I understand. I’ll add your request number on my followup list.
November 4th, 2010 4:16 am
Ticket: 3806869
November 4th, 2010 4:17 am
@Frank, @webdios: I’m adding your request number to my list too.
November 4th, 2010 4:17 am
@Sylvain thank you…
Will there be a way for me to get some sort of formal explanation for my clients?
thx again… dom
November 4th, 2010 4:18 am
@Jean-François; C’est noté. Si vous avez ouvert une requete au support technique, pourriez-vous me donner le # de cette requete svp?
November 4th, 2010 4:20 am
@Jean-François: Les envoi de email devrait etre arrêté.
November 4th, 2010 4:22 am
@Sylvain Please check Ticket #3808080
Server Up but Sites in this server are not working
November 4th, 2010 4:23 am
@Domonic: Yes. I invite you to contact the customer service and ask them what you would like as a more formal explanation.
November 4th, 2010 4:24 am
@Sylvain thx
November 4th, 2010 4:28 am
@Sylvain: Oui bien sur, #3804739. Le ack a été reçu merci ça a été rapide.
November 4th, 2010 4:55 am
Please, Please Check Ticket: 3808113
November 4th, 2010 4:56 am
@Sylvain can you confirm if anyone is even working on my server yet? Brother its almost 4:00 PM here in Thailand…
November 4th, 2010 4:57 am
Thanks Sylvain.
November 4th, 2010 4:58 am
ticket #3808306
November 4th, 2010 5:01 am
@Domonic: I will assign someone to your ticket and a proper follow will be made shortly.
November 4th, 2010 5:02 am
Even my server was down since 5 hrs. Is this the reason for down???
#DEDICATED CL-T151-311CL
I’ve never faced such downtime in 3 yrs of service.
Looking forward to hear from you.
November 4th, 2010 5:07 am
Server down for more than 3 hours now. What the hell iWeb?! ?_?
November 4th, 2010 5:08 am
@Pierre-Luc I am getting serious heat right now because this issue started 8 hours ago for me, and has gone on all through my daylight hours in Thailand… it is currently 4:00 PM here…
I am sure you can understand my position and I appreciate the stress you guy’s must be under right now.
thx/dom
November 4th, 2010 5:10 am
Thanks Sylvain, it seems to be back on-line. Will check all services. Again thanks for the help.
November 4th, 2010 5:11 am
@Sandeep: Your ticket has also been assigned and we will check as quickly as possible.
@Alexis: Have you opened a ticket about this? Please provide me with the ticket number and I will ensure that a proper follow up is being made.
November 4th, 2010 5:21 am
hi guys. i don’t know where you are on dealing the problem but i have a ticket and call for this #3807292 and so far we still have several servers down. without counting for database corruption etc. it could be nice to have at least one answer to let me know where the things are going on… after so many hours of downtime for our entire business.
looking forward to read from you
November 4th, 2010 5:32 am
@frederic: A system administrator will contact you shortly.
November 4th, 2010 5:33 am
finally server up after 5 hrs.
#DEDICATED CL-T151-311CL
November 4th, 2010 5:36 am
Any updates on #3807682 ? Our call center is overwhelmed with cc calls!
November 4th, 2010 5:42 am
server down for over 8 hrs any update yet, its day time here and we r being filled up with client calls and we cant give any of them an eta, it would be good if i could get a faster response.
November 4th, 2010 5:45 am
Hi guys, could you please follow up on issue #3807784 and bump it’s priority? Our backup server is completely overflowed with European traffic.
Thanks!
November 4th, 2010 5:58 am
@Dion, webdios, Damir: I advised the sysadmins to update your cases in your respective tickets. Thank you for your patience and rest assured that you will be contacted shortly.
November 4th, 2010 6:09 am
All the domains in the server are without access by the name. Problems of DNS…. you need to solve that as soon as possible. I go lost two clients for cause of this problem and who is going to restore me!!
Luiz
November 4th, 2010 6:12 am
tickets…
#3808083
#3807879
November 4th, 2010 6:17 am
#3807370 – CL-T159-311CL
#3807395 – CL-T170-182CL
November 4th, 2010 6:25 am
http://www.inkawebdesign.com/whm —-> error 500 :(
November 4th, 2010 6:29 am
I demand an immediate solution.
November 4th, 2010 6:30 am
cl-t079-241cl is down
i lost 14 customer so far , the support told me that it will take ( and another 1 while i`m writing this comment )
what show we say to them , how long does it takes and about the 100% uptime guarantee it is now not guarantee so what you would do for us now , i`m for example lost so far 15 paying customer !!!
what is that !
November 4th, 2010 6:30 am
richard: http://www.inkawebdesign.com/whm —-> error 500 :(
richard: And I have 8 hours with the problem in all the years I have worked in different places never my main website had had this big problem.
November 4th, 2010 6:31 am
Any update on #3808596 (posted an hour ago for CL-T071-110CL) , Been quite till now but would appreciate any update desperately.
Thanks
November 4th, 2010 6:37 am
hello,
my server is still not working CL-T170-371CN
is there a time?
November 4th, 2010 6:38 am
What service is this, that take so much to provide a solution?
November 4th, 2010 6:39 am
Any update on 3806681?
November 4th, 2010 6:44 am
My dedicated server is offline in 10 hours. I am working with my domains … I have some financial losses.
Server ID: CL-T081-152CN
November 4th, 2010 6:47 am
no response for ticket 3806498. Server has been down for 8 hours
November 4th, 2010 6:47 am
Iweb I have with that is going to solve the problem for 8 hours, and in truth and I have no fear I work with a seriousness in the way, I’m with a strong problem and not give me a solution, just tell me to wait, expect them to collect anything? to cash if they cut service there, please for my money I pay for my service is active. And you claim to be leaders in infrastructure, is a disservice both support, and connectivity.
November 4th, 2010 6:49 am
CL-T114-170CN is still down. Please correct this!
I filed a ticket for this. When returning to the customer hub, the ticket is gone. Formatting is off as well, so it is hard to navigate on your support pages. What do I do when not even your support system is working? Re-filed a ticket, and this time it looks like it is in the system: #3809027
November 4th, 2010 6:53 am
Hey!
My server associated with Newelski.com is down as well. Please keep me posted!
Cheers,
Matt
November 4th, 2010 6:54 am
CL-T130-320CL remains down aswell.
November 4th, 2010 7:00 am
Server: CL-T204-080CL
Ticket #: 3804795
APC ON/OFF did not work.
Any update on my ticket?
November 4th, 2010 7:13 am
CL-T201-030CL never came back up. Nobody is answering the phone. How do I get it back up?!!! In about 30 minutes I’m going to have a hundred angry phone calls from all my customers.
November 4th, 2010 7:20 am
CL-T144-221CL is still Down. Has been down for 7 hours already. Clients will start complaining… Any idea for when i will be back?
November 4th, 2010 7:23 am
Thx.
My server is On Line.
November 4th, 2010 7:27 am
#3807859
November 4th, 2010 7:27 am
#3807859 my server still of line !
November 4th, 2010 7:27 am
Server ID : CL-T119-460CL
[TICKET #3808686]
APC ON/OFF did not work !
November 4th, 2010 7:37 am
One of our servers is still down Ticket # 3804501
No update and no communication and I am very disappointed.
It’s pingable but that’s about it.
APC is offline and there is no way to reboot it.
Almost 9 hours – get her back up, please!
November 4th, 2010 7:44 am
no response on ticket 3808113 after 4 hours, and server still down
November 4th, 2010 7:44 am
My dedicated server is offline in 10 hours. I am working with my domains … I have some financial losses.
Server ID: CL-T081-152CN
Ticket ID: #3809274
November 4th, 2010 7:48 am
#3807859 Still down , now i really want to know what is ” SOON ” this soon is taking up to 10 hours ?
regards
November 4th, 2010 7:49 am
My dedicated server is still offline.
Ticket ID: #3807181
Server ID : CL-T083-050CN
November 4th, 2010 8:00 am
Hi. My server is UP and running but the sites hosted on it are DOWN. Help! I already restarted it but nothing happened. Also, the APC login details I received is not working. I’m on a dedicated server. Thanks in advance.
November 4th, 2010 8:00 am
Server ID : CL-T119-460CL STILL OFFLINE
[TICKET #3808686]
[TICKET #3809182]
APC ON/OFF did not work !
November 4th, 2010 8:05 am
Hello,
continued your access via name of the domain… I have access for server via IP, SSH, but by the name of the domains do not have access.
Luiz
tickets…
#3808083
#3807879
November 4th, 2010 8:06 am
Still no answer… ticket id: #3809395
November 4th, 2010 8:07 am
PLEASE HELP ME, MY CLIENTS LOOSE MONEY EVERY MINUTE.
November 4th, 2010 8:12 am
CL-T178-322CN with second hard drive innexistent!., this is CRITICAL.
November 4th, 2010 8:17 am
My dedicated server is offline in 10 hours. I am working with my domains … I have some financial losses.
Server ID: CL-T081-152CN
Ticket ID: #3809274
I have some financial losses. I have some financial losses. I have some financial losses.
November 4th, 2010 8:17 am
CL-T109-100CL
is still down.
this should not happen for sooo long.
been 9 hours now.
work on it.
November 4th, 2010 8:18 am
Our 130,000+ clients expect 100% uptime from us.
We chose iWeb to manage our 15 servers that run our platform due to their 100% uptime guarantee.
Downtime is not an option for us and it has happened too often at iWeb.
I would no longer recommend iWeb to any company that takes customer experience seriously.
WW
November 4th, 2010 8:25 am
i’ve been on iWeb for 2 months and already experienced 2 downtimes…
November 4th, 2010 8:31 am
you are killing my business :(
November 4th, 2010 8:34 am
CL-T081-152CN is still down
November 4th, 2010 8:34 am
CL-T081-152CN is still down for more than 10 hours!
November 4th, 2010 8:36 am
Any updates on ticket #3807598? The server is still unresponsive and a remote APC reboot succeeds but doesn’t help.
November 4th, 2010 8:39 am
I’ve had problems with Iweb from the beginning – starting with a hard disk that failed the day after I got the server, etc. etc. Add to that rude customer service. And now my server has been down for going on 9 hours. Think it is time I leave.
November 4th, 2010 8:41 am
The server has belongs to contact@gefuso.com still down for more than 8 hours. Please help me
The support ticket is #3809260
November 4th, 2010 8:41 am
@ockert agreed…
November 4th, 2010 8:45 am
It’s been more than 13 hours that my server is down, your customer support still asking me to wait, but they didn’t provide any exact time, I need an exact time.
November 4th, 2010 9:17 am
do you have any idea what kind of problem you are creating for all our clients??????
November 4th, 2010 9:27 am
Four servers still down. No response to tickets. Please help.
Tickets: #3809288 + #3809292 + #3809298 + #3809271
November 4th, 2010 9:51 am
Is there anyone?
November 4th, 2010 9:59 am
server : CL-T109-100CL
Ticket : #3809868
URGENT !
November 4th, 2010 10:13 am
ticket #3810081
VERY URGENT!!
November 4th, 2010 10:29 am
there is nobody here, no responses to tickets and live chat and phone support both refuse to provide supervisors or any estimates of how long this is going to take.
CL-T158-012CL has been down over 11 hours now… (not that everyone else here isn’t in the same boat, just adding mine in)
November 4th, 2010 10:30 am
Well, our server is now back up, so that’s good. Sadly MySQL is having problems, but at least the server is up where I can work on it.
November 4th, 2010 10:30 am
12 hours I have met with my server offline, and I’m on the chat, but I have to tell me that my question is keep waiting until I have to wait? And by trying so badly to the user.
November 4th, 2010 10:33 am
Hi,
Please address ticket number 3810478.
Thank you.
November 4th, 2010 10:33 am
@Luiz Cláudio
I’ve requested an update for your 2 tickets :
3808083
3807879
Should not be long.
@everybody : I’m taking care of the follow-ups here now.
I should update you a status within a few minutes
November 4th, 2010 10:34 am
CL-T218-501CL —> server down 12 hour —–> S.O.S.——– > pleaseeeeeeeeeeeeeeeeeeeeeee
November 4th, 2010 10:35 am
unhappy customers of iweb, like me, please contact me at viviana_a at hotmail dot com to take actions, this downtime is unacceptable for a mission critical service, also on response from iweb.
Don’t forget to contact us.
November 4th, 2010 10:44 am
@Mike Tishetsky
#3807370 – CL-T159-311CL
#3807395 – CL-T170-182CL
You should receve an update in a few minutes
November 4th, 2010 10:45 am
I have 12 hours I met with my server offline, and I’m on the chat, but I have to tell me that my question is keep waiting until I have to wait? And by trying so badly to the user. I have talked via chat, and still tells me I have to keep waiting so the service is very bad. I ask you please put my server active.
November 4th, 2010 10:47 am
Please, need update on #3809229 !!
The server is up but the second hard disk is missing!.
November 4th, 2010 10:48 am
CL-T178-322CN NO 2nd. HARD DISK FOUND – URGENT – 12Hs without service.
November 4th, 2010 10:50 am
@Richard (linkawebdesign.com/)
I requested an update on your ticket #3808599
November 4th, 2010 10:52 am
@Hrvoje
I requested an update on your ticket #3808596
November 4th, 2010 10:53 am
@bertrand – iWeb,
No update for me?
CL-T158-012CL
ticket#3809882
I am at 11hours 34minutes…
???????
November 4th, 2010 10:56 am
@Ricardo
We should take care of it within minutes (ticket #3809229 )
November 4th, 2010 10:57 am
Server ID: CL-T081-152CN is still down!
November 4th, 2010 10:57 am
@ali
>cl-t079-241cl is down
I’ve requested an update on your #3807859 ticket
November 4th, 2010 10:58 am
12 + The idle time will be my server?
November 4th, 2010 11:00 am
server : CL-T109-100CL
Ticket : #3809868
you said an update in 30 minutes…
now been 2 full long hours!
URGENT !
November 4th, 2010 11:03 am
@freddy :
>my server is still not working CL-T170-371CN
I’ve created a support ticket for you #3790300
You should have some news within minutes
November 4th, 2010 11:05 am
@The Hilton
>Any update on 3806681?
It seems your server is back up. (as stated in the ticket)
Please let know our team if it’s not the case.
November 4th, 2010 11:10 am
as stated at 10:39am
There are still about 175 servers affected. We followed and replied to comments all night and posted some answers. We have many people on-site and we expect to accelerate the rate at which the remaining servers get back online. There are still power supply problems, failed hard drive problems, fsck required problems and other related problems. We should be able to fix most of the power supply problems left and run most of the fsck quite quickly but when hard disks have to be replaced and reinstalls needed it might take a little longer.
November 4th, 2010 11:11 am
@Mohamamd
Server ID: CL-T081-152CN
cl-t081-152cn.privatedns.com => server seems to be up (respond to ping)
Please reply to your ticket if you need more help.
November 4th, 2010 11:12 am
@AP
>no response for ticket 3806498.
I’ve requested an update.
November 4th, 2010 11:13 am
Iweb gentlemen, please fix my server, I beg you with love, I have over 12 hours with this problem can see my server and fix it please.
November 4th, 2010 11:16 am
@Katittut
>it looks like it is in the system: #3809027
It seems your server is back (as stated in the ticket).
Please let know our team if it’s not the case by reopenning the ticket or replying to the ticket (last message received).
November 4th, 2010 11:18 am
just had a live chat tech tell me that nobody has even started working on my server … it’s been down over 12 hours???
Bill: ticket# 3809882 CL-T158-012CL
Julie B.: We have not started to work on your server yet
and this after an hour on live chat?
what is going on here????
November 4th, 2010 11:21 am
@Matt
>My server associated with Newelski.com
I would need the server ID or IP address as it does not resolves.
Much better would be to place a ticket and give the number to me.
November 4th, 2010 11:26 am
@dnm
>CL-T130-320CL remains down aswell.
I’ve requested an update on your #3809113 ticket
It should not be long.
November 4th, 2010 11:27 am
now it is up and running, thanks
November 4th, 2010 11:27 am
@Gustavo Barrero
>Server: CL-T204-080CL
>Ticket #: 3804795
It seems your server is back (response to ping as stated in the ticket).
Please let know our team if it’s not the case or if you need more assistance by reopenning the ticket or replying to the ticket (last message).
November 4th, 2010 11:31 am
11:22am:
In the next following minutes we are going to proceed with emergency tests on the electrical panel transfer switch that was the cause of yesterday’s service interruption. We have to proceed as soon as possible because we do not want to depend on this piece of hardware in case of a new power outage. We will keep you informed as soon as this test is completed.
November 4th, 2010 11:32 am
cl-t108-131cl has been down for 12 hours! When is it going back up?! This is very frustrating
November 4th, 2010 11:34 am
CL-T222-090CL Come on! we’ve been down for over 12 hours!!! :@
November 4th, 2010 11:36 am
@freddy :
The REAL ticket number is #3810862
#3790300 was your programming problem from yesterday
November 4th, 2010 11:38 am
@AL @Jerry –
If you don’t have a ticket in, I might suggest you do so..then jump on the live chat and ask if anyone has looked at your server yet. I got told that mine hadn’t even been looked at (after 12 hours), and the server came back online minutes after the live chat tech disconnected me.
How that can be of some help to you…
November 4th, 2010 11:38 am
@Oz
>CL-T201-030CL never came back up
I’ve created a support ticket for you #3811139
You should have some news within minutes
November 4th, 2010 11:39 am
server : CL-T109-100CL
Ticket : #3809868
you said an update in 30 minutes…
now been 2.5 full long hours!
do i have to make multiple support ticket?
URGENT !
November 4th, 2010 11:45 am
server id : CL-T195-181CL
took many hours without access, I need to re-establish the service and I can not wait any longer, I’ll lose many customers, I have a ticket # 3810081, and have received no response, I have spoken to chat with you and I do not give information please someone tell me something about my server.
URGENT !!!
November 4th, 2010 11:45 am
@Santos
>Server ID : CL-T119-460CL
>[TICKET #3808686]
I’ve requested an update on your ticket
It should not be long.
November 4th, 2010 11:49 am
@stef
>server : CL-T109-100CL
>Ticket : #3809868
>you said an update in 30 minutes…
>now been 2.5 full long hours!
>do i have to make multiple support ticket?
Please do not do it will be much longer.
I’ve requested an update on your ticket.
Sorry for this delay.
Have you tried the APC reboot ?(sorry if you’ve already done it)
merci encore de votre patience
November 4th, 2010 11:53 am
@Frank
> One of our servers is still down Ticket # 3804501
I’ve requested an update on your ticket
It should not be long.
November 4th, 2010 11:58 am
@LI
>Ticket ID: #3807181
>Server ID : CL-T083-050CN
It seems your server is back (response to ping).
Please let know our team if it’s not the case or if you need more assistance by reopenning the ticket or replying to the ticket
(last message).
November 4th, 2010 12:00 pm
Coud you please check ticket #3809990. I keep receiving responses that it is back online and you can ping it but I keep insisting the problem is main data partition is missing. Could you please check harddrives and RAID? Thanks in advance
November 4th, 2010 12:03 pm
Hello gentlemen iweb how my server?
November 4th, 2010 12:08 pm
@Dennis
> Hi. My server is UP and running but the sites hosted on it are DOWN.
I’ve merged your 2 tickets in one : 3807307 and asked for an update.
Thanks for your patience
November 4th, 2010 12:08 pm
Hi guys,
I’ve reported the problem per ticket below. The machine now responds to ping, but it seems it was WIPED CLEAN. Chatted to support but the guy could not help much. Is it possible that you wiped the machine by mistake, or did you build the new machine with the intent to transfer the old stuff to it?
I’d appreciate getting a response from someone who actually made the decision to wipe the machine to understand whether this is really the case.
Thanks!
Ticket #3807784
Server DEDICATED CL-T204-120CL
November 4th, 2010 12:10 pm
http://CL-T218-501CL.privatedns.com:2086/
server down
November 4th, 2010 12:11 pm
@Bertrand-iWeb
:
>>server : CL-T109-100CL
>>Ticket : #3809868
>>you said an update in 30 minutes…
>>now been 2.5 full long hours!
>I’ve requested an update on your ticket.
>Sorry for this delay.
>Have you tried the APC reboot ?(sorry if you’ve already done it)
>merci encore de votre patience
Bertrand, i can’t proceed with an APC reboot atm.
damages to my business are huge. Please update me
and make it back online
November 4th, 2010 12:13 pm
Please Help:
SERVER CL-T119-460CL -> Still Offline
November 4th, 2010 12:25 pm
cl-t173-081cl is still down and I’m afraid I can’t wait anymore.
November 4th, 2010 12:26 pm
CL-T173-081CL
November 4th, 2010 12:27 pm
The server has belongs to contact@gefuso.com STILL down for more than 12 hours. The ticket is#3809260
Can someone please reply me and fix it, please?
I have got already some financial losses with some customers.
November 4th, 2010 12:28 pm
server id : CL-T195-181CL
ticket: # 3810081
took many hours without access, I need to re-establish the service and I can not wait any longer, I’ll lose many customers, I have a , and have received no response, I have spoken to chat with you and I do not give information please someone tell me something about my server.
URGENT PLEASE !!!
November 4th, 2010 12:37 pm
Any idea of how long all issues will be resolved. Still waiting…
November 4th, 2010 12:42 pm
@Mustafa Magdy
>PLEASE HELP ME, MY CLIENTS LOOSE MONEY EVERY MINUTE.
I’ve created a support ticket for you #3811759
It will be faster next time if you open your request as soon as you detect a failure.
You should have some news soon.
November 4th, 2010 12:46 pm
Dear iweb,
this very disappointing such a big hosting company facing power problem. We will the power restore and what is the expected time.
Thanks
November 4th, 2010 12:54 pm
This is a total disaster .. I am sure will move all my servers …?!
November 4th, 2010 12:56 pm
@Brett Flannigan
>Any updates on ticket #3807598?
You should have had an update a few minutes ago, on team is testing the hardware to find the fastest resolustion.
Do not hesitate give them more details if you need more assistance by reopenning the ticket or replying to the ticket (last message).
November 4th, 2010 1:00 pm
@bertrand -iWeb
Any Updates?
Server ID : CL-T119-460CL STILL OFFLINE
[TICKET #3808686]
November 4th, 2010 1:02 pm
#3809113 _ still waiting for the installed KVM to be put back online?
November 4th, 2010 1:17 pm
Dear Sirs iWeb
server id: CL-T195-181CL
ticket: # 3810081
Take her to many hours without service, I sent a support ticket, I just received a reply on the ticket of the occurrence, at any time tell me whether or not working on my server, I have connected several times to chat live, and all I’m saying is that they have no news on my server, I have 8 servers hired you, I do not deserve this little attention from you, I have my clients call and here I have not received the slightest help or news about my server, and not to turn to get some news about when my service will be restored, I’m tired of this situation, I demand an explanation of why no one is able to meet my server, in theory you had redundant systems, but the truth everything failed, who is responsible for this situation
November 4th, 2010 1:21 pm
Ticket #3809442
My server is still down!! It has been Hours!!!
I am LOOSING MONEY every minute!
Please solve it asap!
November 4th, 2010 1:22 pm
Please take care of cl-t180-262cl
November 4th, 2010 1:23 pm
Please take care of cl-t180-262cl –> [RQ #3810610]
November 4th, 2010 2:04 pm
Holy man…
November 4th, 2010 2:20 pm
@@Bertrand-iWeb
:
>>server : CL-T109-100CL
>>Ticket : #3809868
> Please update me and make it back online
As stated in the ticket 30 minutes ago, the primary disk is not recognized now.
Our team is currently re-installing your OS on a new drive and we’ll plug the old one after to try to recover data.
November 4th, 2010 2:31 pm
@Gio (#3809442) and @AP (cl-t180-262cl –> [RQ #3810610])
your tickets are being treated now
November 4th, 2010 2:55 pm
Hi to all
My server is up now and I took some time to find out. Try to:
1- Ping your IP
2 – If you get answer back, just type http://your IP /whm and reset the DNS server
3 – Later on, reset all the services
And then everything goes normal again!
I hope this can help someone!
Fabio de Brito
November 4th, 2010 2:55 pm
@Richard
server : CL-T218-501CL
As stated in your #3808599 ticket, your server is back online.
do not hesitate to reply to the last email or comment the ticket in the customer hub if you require more assistance.
November 4th, 2010 3:10 pm
@osh
> Coud you please check ticket #3809990.
I’m re-asking for an update.
November 4th, 2010 3:15 pm
Pleaseee
Server: CL-T129-470cl
Ticket #3806929
16 Hours Offline
i need help!!!!!
November 4th, 2010 3:26 pm
@Rita
Could you please give our team more information since your server is back since this morning (8h40 am EST).
It is actually responding to ping and to http requests : http://70.38.31.186/
Please reply in your ticket with some more details on what is the problem you’re having.
If it is related to http://labotana.com/, specify it in the ticket so our team can see the error.
thank you
November 4th, 2010 3:37 pm
[...] in the case of iWeb, you can see here lots of drama. That’s more than 500 comments in a few hours. Lots of angry customers, a few supporting [...]
November 4th, 2010 3:55 pm
@ali
>cl-t079-241cl / #3807859 ticket
You will have an update soon from our team, the fsk has ended, our team is checking if everything is ok.
Thanks
November 4th, 2010 4:01 pm
Hi,
My site been down for more then 14 hours… can you please check this ticket #3807086..
November 4th, 2010 4:05 pm
Please.. Please.. Please.. My ticket opened ~ 4h and anymore resolved nothing.
my ticket number is #3809974
November 4th, 2010 4:09 pm
WOW !!! Iweb just told my that my servers hard-drive was completely defective
No way to Recover my Data…
THEY JUST KILLED MY BUSINESS !!!!
:( :( :(
November 4th, 2010 4:43 pm
@stef : That’s what backups are for
Truth to be told, my own backups are almost a two weeks old so I should probable backup more often as well
November 4th, 2010 6:00 pm
Ok let me add to this thread has a Sysadmin point of view:
1st : most of the server seems to be not coming back because of “fsck” check. : easily fix if you take schedule time to reboot your server. Having 600 days of uptime “might” look cool but is really inapropriate for critical business.
You should reboot your server a couple of time during the year, to ensure that both file system and disk are OK.
Also, you can schedule a “hard” reboot to test the hardware by doing an APC reboot of your server. since it’s schedule, if anything bad have to happen or hardware to fail, it might just do it then and you can proceed to correct the issues.
Old hardware is old hardware…. you know it will fail at somepoint….just take the precaution to make it fail when you schedule it. ;)
November 4th, 2010 6:20 pm
i have a problem i lost all my data in disc i want to receive a welcome letter to my email
November 4th, 2010 6:33 pm
@Ahmed: Did you contact our support team? Please contact them and open a ticket with them. Then post your ticket number here. We will follow up with the team. Thanks
November 4th, 2010 9:50 pm
Latest update is available here: http://blog.iweb.com/en/2010/11/incident-power-distribution-%e2%80%93-data-center-cl-update-3/6045.html
November 4th, 2010 9:52 pm
Every i am thinking has been said in earlier posts. But this is definitly bd for everyone. If i dont get my next month servers for free i am moving my services asap.
November 4th, 2010 10:13 pm
@Unhappy Customer: You are covered by our SLA guarantee. You can request SLA credit through your Customer Hub
November 5th, 2010 4:40 am
hello,
my server is still not working CL-T170-371CN
almost 48 hours?????????????????????????????????????
November 8th, 2010 10:00 am
Monday, November 8, 9:50 EST: Latest and final update on the situation available here: http://blog.iweb.com/en/2010/11/incident-power-distribution-%e2%80%93-data-center-cl-resolved/6062.html.