BT have reported a switch failure at Reading3 resulting in ADSL service loss for some of our customers. BT anticipate clearing the fault at 11:26. We apologise for any inconvenience.

There is currently a problem with one component of a core switch cluster in Maidenhead. We will shortly be resetting it. If this does not restore normal operation, we will need to reboot the entire cluster, which will entail a minute or so downtime for all services traversing the cluster.

Update 10:20

The switch element in question (beatrix2) has suffered complete hardware failure. Fortunately most of the services it provides are dual-fed; those not have been re-routed. Replacement hardware has been ordered and will hopefully be installed on Tuesday.

We have just had a short outage on our BT connections. Connections have now restored. We are awaiting an explanation.

It looks like lines have come back up & stayed up for the last hour or so.
We will be keeping an eye on them to ensure they stay up.

At 09:13 this morning all of BT’s BM-TH RASs went down. This BT equipment is located in Birmingham, but serves a wider geographic region than just Birmingham.
Associated 21CN lines (those served by 21CN-BRAS-REDx–BM-TH RASs) are still down.
Symptoms observable on Watchfront customer’s routers will typically be ADSL connection up, but PPP connection down, since the router is unable to login to our network – this is because the RAS failure is preventing end-to-end connectivity between the router and our systems.
This will likely be affecting a large number of lines, and multiple ISPs.
BT have raised an incident and an engineer is due on site to investigate possible faulty hardware.
Further updates will be made as information becomes available.

Our main router has been re introduced and normal service has resumed.

One of our core routers in Bluesquare 2 Maidenhead is temporarily out of service and therefore there is a minor risk of disruption as we are currently running on the backup router there. There is also a possibility of a short outage as the main router is re introduced, however we plan to do this out of office hours.

BT have resolved the packet loss problem with their BT Connection Node at Stepney Green, and services have returned to normal

There was an outage of our Packet Exchange link to Amsterdam last night, between 01:50 to 02:15. This will have affected any traffic to servers in our Amsterdam data centre that routes via Maidenhead. Apologies for any problems caused.

The problem is with the BT Connection Node at Stepney Green, and is affecting a large number of ISPs. BT are working on it, no ETA for a fix as yet