On September 27th we received alerts that our Portland network was offline. Upon contacting the data center we were informed that their whole network was offline due to a problem with their upstream provider. During this outage all traffic was re-routed over other transport providers which resulted in some minor performance degradation while they worked to fix the main problem. Since our website and control panels are hosted on this network, our website was unavailable and our domain was redirected to our Twitter for most of the outage so we could provide updates as we received them. Below are the e-mails we received from our data center:

(Initial e-mail)
At around 1:03PM we received notification that our Seattle and Portland transport circuits are down, this affected DDOS protected customers in Portland facility.
We have contacted our provider Spectrum networks, they are currently investigating the issue. We will keep you updated. Sorry about the inconvenience.

(Update 1)
We experienced issues with our Seattle-Portland Transport circuits around 1:03PM this afternoon, which affects DDOS protected customers in our Portland facility. 
Our transport circuit provider Spectrum networks have investigated and identify the issue leads to one of their switches that possibly gone bad in their network, they are working to resolve the issue right now. 
While waiting, we have currently deployed a temporary reroute solution to bring most of the affected customer online however some network performance may be degraded at this time.
If you still experience issues please let us know and we will try our best to resolve it until Spectrum network have restore our transport circuits.
Thank you for your patience.

(Update 2)
We have just received word from Spectrum networks that they have resolved the network issue as of 8:30PM, our transport circuits have come back online. We are currently rerouting traffic back to these circuits. Performance should be back to normal in a few minutes.

The total length of the outage did exceed our 99.9% SLA so all clients in our Portland location have received a 25% SLA credit for this outage.

Outage began: Sep 27 2015 13:03:43 GMT-7.0
Outage resolved: Sep 27 2015 15:05:10 GMT-7.0

-The Secure Dragon Staff


Wednesday, September 30, 2015





« Back