We received an alert that our network went offline at 12:40PM EST today and after investigating the cause it was determined that we had lost contact with all of our BGP neighbors and our uplink NIC was unable to reset itself. We rebooted the router which resolved the issue but then we had began to experience some connectivity issues as a result from an ongoing DDOS attack that started yesterday against a client that we have been successfully mitigating but with the router reboot it caused our configurations to reset (our policy is not to save configuration changes for temporary issues).
This announcement was delayed while we continue to investigate the current DDOS attack along with a possible DOS attack originating from our network (at this time we do not see anything in our logs that suggest this but we are reviewing logs from other providers at this time).
In an effort to prevent future issues we will be scheduling network maintenance for next week to install our redundant routers and switches (all of which arrived this week). Having 2 routers, 2 switches, and 2 network uplinks (connected to 2 different switches and routers upstream) will allow us to have complete network redundancy and automated failover. Tonight we will be discussing the maintenance and an e-mail will be sent out to clients when a schedule is ready.
-The Secure Dragon Staff
Cümə axşamı, İyul 5, 2012
