Tuesday, 20 January 2009

Monday's Network Issues - 19/01/09

I apologise to our customers affected by the network issues yesterday. I've detailed below the events of the afternoon as reported by our platform provider Gradwell and we are told that these same issues should not happen again.

Network issue

We are currently aware of an issue which is affecting our virtualised network in London. Our server team are investigating and we will update customers as soon as possible with further information.

Update 14:30 Our server team are currently restarting some of the key servers within our Telehouse cluster and we are working closely with our platform vendors to identify the cause of the network issue we are currently seeing. We hope to provide a resolution to this problem as soon as possible.

Update 15:00 We are currently recovering all affected services and expect all services to be fully online shortly.

Update 15:40 Whilst the majority of services are now back in operation, including our VoIP NAT proxies. Our virtual PBX lon-pbx-14 is not yet back in operation. We apologise for the ongoing inconvenience to customers using these services.

Update 18:10 Our VoIP Centrex server lon-pbx-14 has now been brought back online and is handling calls correctly. We apologise for the length of time this server was unavailable.

Update 19:30 All known issues with our servers have now been resolved. If you are experiencing any remaining problems, please contact our customer services team, who will be able to advise you and inform our server team of any problems which may remain. Apologies for the extended problems today. Our server team are working through a lot of changes which should make our network more resilient in future.

0 comments: