Service Status

24/10/08
12:42

Auto Draft

Some details on the outages earlier today – they were caused by a transit providers’ router announcing routes it couldn’t route, effectively black-holing those IP addresses. They have now replaced the router in question, so we can be reasonably confident the problem has now been resolved.

We are not 100% sure what IP addresses were affected, but it will have affected many of our customers. For your info the outages were from approx 11:10 to 11:22, and 11:32 to 11:36.

Once again we do apologise for any problems this may have caused.

Posted by Paul Malkowski
24/10/08
11:38

Auto Draft

We have just seen another 4 minute outage, I believe for the same reason, and are investigating. Apologies once agin

Posted by Paul Malkowski
24/10/08
11:25

Auto Draft

We have just suffered an outage that we believe was caused by a routing problem with one of our transit providers. Everything should now be back to normal. We will post more details shortly, and do apologise for the outage.

Posted by Paul Malkowski
14/10/08
09:55

Auto Draft

At 9:40 this morning we again lost all connectivity to our Amsterdam facility. It was restored at 9:50 – we are awaiting an explanation from our suppliers and will post an update when we receive one.

Posted by Paul Malkowski
07/10/08
10:29

Auto Draft

Last night between 2:00am and 3:45am, most (approximately 90%) of our ADSL connections were reset by BT. This was not notified in advance and as yet we have no explanation.

Most of the affected lines reconnected automatically, but unfortunately some did not – if still affected, power-cycling your ADSL router should clear the problem.

Apologies for the inconvenience. If we receive an explanation from BT we will post an update.

Posted by Paul Malkowski
04/10/08
20:37

Auto Draft

We have just received the following explanation for today’s outage in Amsterdam:

“On October 4th, approximately between 16:03 hrs and 18:00 hrs, a large area of Amsterdam has suffered from a severe power outage. Unfortunately also Science Park Amsterdam, where one of the SARA Datacenters is located, was confronted with this failure.

The Emergency Power Supply took over the major part of the power delivery, but unfortunately one of our four UPS systems malfunctioned. As a result some customers experienced a short outage of approximately 6 seconds on one of their two powerfeeds. After the 6 seconds the generators came online and provided full power on all feeds, including the affected one. However, a small number of racks needed a manual reset and was affected longer. The failure had consequences among others for the internet traffic and some other SARA services. At this moment most services are restored.

By now the external power situation is stable and normal again. SARA is investigating the cause of the malfunction of the UPS system. If needed, the generator will preventive be put online and running.

We are sorry for the inconvenience. If you need assistance you can contact us for support by one of our onsite engineers.

Apologies for any inconvenience this may have caused.”

Posted by Paul Malkowski
04/10/08
17:53

Auto Draft

We have just received the following statement from our supplier:-

Power appears to have restored to our equipment in SARA and all services should be back up and functioning normally at the moment.

We have, however, not yet received the formal all clear notification so services that were down are currently considered at risk.

Further updates to follow.

Posted by Paul Malkowski
04/10/08
16:13

Auto Draft

Connectivity has just been restored. If we receive any explanation from our suppliers we will post an update.

Posted by Paul Malkowski
04/10/08
15:54

Auto Draft

We have just been notified that there is currently a power failure in another Amsterdam datacentre which is affecting various connections. We have been told that engineers are working on the fault but no ETA is yet available. We will update as we find more.

Posted by Paul Malkowski
04/10/08
15:51

Auto Draft

We have confirmed that power to our Amsterdam equipment is OK – investigation continues.

Posted by Paul Malkowski