24
Oct
2008
12:42

Some details on the outages earlier today – they were caused by a transit providers’ router announcing routes it couldn’t route, effectively black-holing those IP addresses. They have now replaced the router in question, so we can be reasonably confident the problem has now been resolved.

We are not 100% sure what IP addresses were affected, but it will have affected many of our customers. For your info the outages were from approx 11:10 to 11:22, and 11:32 to 11:36.

Once again we do apologise for any problems this may have caused.

Posted by admin

24
Oct
2008
11:38

We have just seen another 4 minute outage, I believe for the same reason, and are investigating. Apologies once agin

Posted by admin

24
Oct
2008
11:25

We have just suffered an outage that we believe was caused by a routing problem with one of our transit providers. Everything should now be back to normal. We will post more details shortly, and do apologise for the outage.

Posted by admin

14
Oct
2008
09:55

At 9:40 this morning we again lost all connectivity to our Amsterdam facility. It was restored at 9:50 – we are awaiting an explanation from our suppliers and will post an update when we receive one.

Posted by admin

07
Oct
2008
10:29

Last night between 2:00am and 3:45am, most (approximately 90%) of our ADSL connections were reset by BT. This was not notified in advance and as yet we have no explanation.

Most of the affected lines reconnected automatically, but unfortunately some did not – if still affected, power-cycling your ADSL router should clear the problem.

Apologies for the inconvenience. If we receive an explanation from BT we will post an update.

Posted by admin

04
Oct
2008
20:37

We have just received the following explanation for today’s outage in Amsterdam:

“On October 4th, approximately between 16:03 hrs and 18:00 hrs, a large area of Amsterdam has suffered from a severe power outage. Unfortunately also Science Park Amsterdam, where one of the SARA Datacenters is located, was confronted with this failure.

The Emergency Power Supply took over the major part of the power delivery, but unfortunately one of our four UPS systems malfunctioned. As a result some customers experienced a short outage of approximately 6 seconds on one of their two powerfeeds. After the 6 seconds the generators came online and provided full power on all feeds, including the affected one. However, a small number of racks needed a manual reset and was affected longer. The failure had consequences among others for the internet traffic and some other SARA services. At this moment most services are restored.

By now the external power situation is stable and normal again. SARA is investigating the cause of the malfunction of the UPS system. If needed, the generator will preventive be put online and running.

We are sorry for the inconvenience. If you need assistance you can contact us for support by one of our onsite engineers.

Apologies for any inconvenience this may have caused.”

Posted by admin

04
Oct
2008
17:53

We have just received the following statement from our supplier:-

Power appears to have restored to our equipment in SARA and all services should be back up and functioning normally at the moment.

We have, however, not yet received the formal all clear notification so services that were down are currently considered at risk.

Further updates to follow.

Posted by admin

04
Oct
2008
16:13

Connectivity has just been restored. If we receive any explanation from our suppliers we will post an update.

Posted by admin

04
Oct
2008
15:54

We have just been notified that there is currently a power failure in another Amsterdam datacentre which is affecting various connections. We have been told that engineers are working on the fault but no ETA is yet available. We will update as we find more.

Posted by admin

04
Oct
2008
15:51

We have confirmed that power to our Amsterdam equipment is OK – investigation continues.

Posted by admin

04
Oct
2008
15:17

All connectivity to our Amsterdam equipment is currently down – we are investigating and will update ASAP.

Posted by admin

Current Status

    GoodNo current issues

Status Archive