[Resolved] Partial outage Amsterdam 1 datacenter

Update 13:30 All VM disks have been fsck’d, a few minor errors fixed, no major problems found.

Update 11:15 Service has been restored, however we will be shutting down all VMs hosted in Amsterdam 1 one at a time to run fsck to ensure the disks are clean. This will take a few minutes per VM.

10:55 A partial outage is affecting Xen VMs hosted at our Amsterdam 1 datacenter. We are investigating and hope to restore service within the next 15 minutes.

[Resolved] Outage Amsterdam 1 datacenter

Update 11:48: Service has been restored. A faulty linecard in an edge switch caused the outage. Our apologies for the inconvenience caused.

10:36: We are currently experiencing IP transit problems at our Amsterdam 1 datacenter which is affecting some routes. Network operations is investigating, please check back shortly for an update.

[Resolved; Update] Outage Amsterdam 2

Update 2014-03-20: Our IP transit provider has provided additional information in relation to the service disruption yesterday.
– The attack was so intense it completely saturated their 10Gbps core switches.
– A 3rd party specialist firm was brought in to filter out the DDoS and let legitimate traffic through.
– The Dutch police are investigating with a view to prosecute the perpetrator of the attack.
– The customer who the attack was targeting are being moved to a segregated IP network so any potential reoccurances of the attack won’t affect our connectivity.

Update 15:12: Service has been fully restored.

2014-03-19 14:25: Our IP transit provider at our Amsterdam 2 datacenter is currently experiencing a DDoS attack on their infrastructure which is affecting connectivity for customers located in our Amsterdam 2 datacenter. Network operations are working on a solution but we do not yet have an ETA. Apologies for the inconvenience caused.