HWS Server Status Updates

We’re investigating (13:33 GMT) as to why US1 is down

EDIT – 13:41 GMT – This appears to be a network issue and we are raising this with the DC.

EDIT – 13:41 GMT – All servers should be responding as of the time of this post.

We are rebooting this node following stability issues. (11:21 GMT)

As per our notification this week: Planned maintenance is due to take place at 10pm BST on our UK1/UK2/UK3 nodes. This is network related, 10-20 minutes of downtime is expected.

EDIT 22:13 BST – Connectivity has been restored following the completion of the upgrade.

We’re rebooting uk2.hwshosting.net following some configuration tweaks

Our datacentre has decided that in order to improve quality of service they would like to move all Rack customers including ourselves, into a new area of the datacentre where we will benefit from improved security, environmental conditions, physical access and shortly a more resilient lower-latency network.

Unfortunately this move is going to require a physical relocation of all of our equipment into new racks, and therefore downtime for all but a couple of our servers. We are very sorry to have to announce further planned maintenance following outages last year related to the Network and Power within our datacentre, however unfortunately this move is being forced upon us. Ultimately this is going to result in a better quality of service, and we look forward to improved network infrastructure, ipv6 support and hardware upgrades for some of our older systems in the upcoming months.

In order to ensure minimal disruption, we will be starting migration of equipment at midnight (00:00 BST/GMT+1) on 21/04/11 through the early hours of the morning, and expect full service to be resumed before business hours.

Outage durations will vary depending on which server you are hosted on, but we will be working as quickly as possible.

Important: Clients hosted on our UK network with IP addresses 95.154.244.xx will be effected. All other UK hosted clients (213.x.x.x and 94.76.237.xx ranges will not be effected).

Our shared hosting cluster will be effected by this move to so shared and reseller hosting clients hosted on our UK cluster will experience downtime.

All data is safe and we will be making sure that all equipment is safely turned off, migrated and then turned back on while having all of the services up and running before the business hours.

This move will not effect any of our US based services.

Support

We will have full onsite and offsite staff during the maintenance migration. Should you require any assistance or have any questions please email support directly at support@hwshosting.net or follow us on Twitter at http://www.twitter.com/hwshosting

As mentioned before we sincerely apologise for the inconvenience. The decision to relocate our racks has been taken by our datacentre in order to provide us with a more secure a resilient environment.

Thanks for your understanding, and we apologise in advance for any inconvenience this may cause.

10:15 AM GMT – Investigating as to why this is down, updates to follow.

10:19 AM GMT – This appears to be affecting large portions of BlueSquare House, therefore it’s looking like power or network related rather than hardware on our end. Awaiting confirmation now.

10:40 AM GMT – This is indeed power related, BSQ2/BSQ3 currently down. We’re awaiting an ETA.

11:27 AM GMT – Connectivity is slowly returning.

12:19 PM GMT – Servers should now be coming back online.

19.19 GMT – We are issuing an all clear, anyone not yet online should please contact support@hwshosting.net and billing@hwshosting.net regarding account credit. Please remember the billing department operates 9am-5pm Monday to Friday.

18.27 GMT – Shared/Reseller hosting should be online now, and we are slowly bringing IPs back into network connectivity.

17.58 GMT – We’re working on mitigating this however this will take a little longer yet, we apologise and once this is over we will be offering account credits and taking steps to avoid this again in the future.

17.54 GMT – We’re waiting for this to subside, apologise, sadly no ETA as yet.

17.28 GMT – We can confirm this is a DDOS which is being null routed at present.

16.56 GMT – UK1 appears to be unresponsive, this is also being investigated

16.48 GMT – This is looking like a possible DDOS, we have staff looking into this now.

16.30 GMT – UK2.hwshosting.net is down, we are investigating this.

10.44am GMT – this is being mitigated by our upstream provider, updates to follow as we get them.

UPDATE 11.15am GMT – No ETA as yet, Upstream have informed us that the switch is the likely target rather than a single server or servers, they are working hard to restore stability. A full RFO will be issued once this outage is over.

UPDATE: 12.01 GMT – We’re seeing stability returning, awaiting all clear from Upstream at present.

UPDATE 14.28pm GMT – This is being monitored very closely for the next 24 hours to ensure this has been fully mitigated. You may contact billing@hwshosting.net to request SLA credits.

This is currently down, we’re investigating (12.57 GMT)

After a small DDOS this should now be coming back under control, please report any further issues to support@hwshosting.net (13.16 GMT)

One of our Nodes is currently experiencing a DDOS, this is being isolated and service should resume momentarily.

Please accept our apologies for the inconvenience caused by this.

Service restored as of 4.10am GMT