Brief glitch on service
We apologise if any customers experience a brief glitch to their service.
We needed to apply an emergency upgrade to our machines Tolhek and Turnpike which caused the tunnels to drop for a few seconds.
Both machines are now running fine.
Congestion and high latency 23/04/25 – update
UPDATE:
Our wholesale provider has identified an issue with one of their gateways. Whilst they are working to resolve the problem we ask affected customers to reboot their routers.
We will continue to monitor customer lines.
_________________________________________________
Some of our customer lines are experiencing congestion and high latency this morning.
We are investigating the root of this issue with our wholesale provider.
We will update as soon as we have information.
We apologise for the inconvenience this issue may be causing.
Service issues – 17/04/25
We are aware some customers are experiencing issues with their services today.
We have raised an issue with our suppliers and we are currently waiting for feedback.
We apologies for an inconvenience experienced.
Core network problems
Since approximately 22:00 on 05/06/24 our core network has been exhibiting severe packet loss. Investigations are ongoing, but we have no ETF yet. We apologise for the poor performance.
Update:-
We believe the problem last night was caused by a flood of TCP SYN packets. They don’t use much bandwidth, but do use a lot of CPU resource, leading to the packet loss. We are working with the FireBrick development team to see what improvements can be made to mitigate the effect should it occur again.
Update on today’s connectivity issues
Following the second outage this afternoon we undertook an emergency investigation at our data centre to determine the root cause of the outages today.
We apologies for the poor/non-existent connectivity customers experienced.
The cause was found to be a rogue machine that was sending a large amount of traffic where it shouldn’t have, and in the process tripped various router and switch limits. It has now been fixed, the trips have been cleared and customers would have seen connectivity restored around 3pm this afternoon.
We will as always continue to monitor.
Thanks for your patience.
Watchfront have planned maintenance at our datacentre scheduled for Sunday 26th October from 12:00 pm.
We will be conducting the final phase of the physical changes to equipment in our racks. Customers are advised the mail server will be down during the maintenance period.
We apologise for any inconvenience this may cause.
UPDATE: This phase 1 of maintenance is now complete. We will be issuing further a maintenance notification for phase 2 planned for Wednesday 22nd Oct.
Watchfront have planned maintenance at our datacentre scheduled for Monday 20th October from 11:00 am.
We will be conducting physical changes to equipment in our racks. A small number of our tunnelled customers may experience a few seconds of outage whilst we carry out the changes.
Services are considered AT RISK during the maintenance period.
We apologise for any inconvenience this may cause.
Following on from the maintenance carried out in September, one of our DSL suppliers is due to conduct the upgrade of switches in their datacentre on Tuesday 7th October 2025:
Start: 07/10/25 00:01 BST
End: 07/10/25 06:00 BST
During the maintenance window, customers can expect a blip in service whilst the primary LNS disconnects and the secondary LNS takes over. Once the maintenance is complete and the interconnect has settled, we will restore services to the primary LNS manually over a couple of days to minimise disruption. Again this would cause a blip in service as they are moved back.
We apologise for any inconvenience this may cause.
Watchfront have a planned maintenance scheduled for Wednesday 17th September 2025 at 18:00.
We plan to conduct a minor configuration change on an interconnect with a supplier.
We advise an “AT RISK” status whilst we conduct this maintenance as some DSL connections may drop but any that do will immediately reconnect.
We apologise for any inconvenience this may cause.
We have been notified that one of our interconnectivity suppliers will be conducting some essential core network maintenance, on Tuesday 17th June 2025 between the hours of 00:01 and 04:00 BST.
Customers with ADSL or FTTC TalkTalk lines are likely to suffer some downtime during this outage.
We apologise for the inconvenience caused whilst this maintenance is undertaken.