Network Outage October 4th

[Rogean]

At 12:09AM our Atlanta secondary path went down for scheduled and anticipated maintenance that was slated to be non-customer impacting, however at 12:12AM our primary fiber to Atlanta and Ashburn went down as well, both served by a different provider. While service has been restored via Ashburn at this time, we are still investigating the additional outages and will update you as soon as we have further information.More info as it comes.

HEADS BE ROLLIN'

Update 1:
4:00 AM EDT UPDATE

At 12:09AM our Atlanta secondary path went down for scheduled and anticipated maintenance that was slated to be non-customer impacting, however at 12:12AM our primary fiber to Atlanta and Ashburn went down as well, both served by a different provider. At 01:42AM, Ashburn connectivity was restored, and at 03:08AM Atlanta secondary/protect connectivity was restored. We are still working with our providers to fully understand the reason for this massive outage, and why our Atlanta primary fiber remains offline. As soon as we have further information, we will update you.

[nhauk]

hurry up already, the wifes asleep and i need EQ

[Alarti0001]

I thought Skynet has attacked *phew*

[President]

This kinda shit happens all the time unfortunately Rogean. Luckily it only happens "all the time" across the globe.

Dark fiber is also such a clusterfuck that sometimes you think you are buying different fiber routes and are not.

Example: Company A owns fiber in said city. Company B & C want to run fiber/traffic through said city and both lease fiber from Company A. Company D has their headquarters in said city, and buys protected links from both companies, which due to leasing fiber from Company A, actually run the exact same path. Company A has to do maint on fiber, and somewhere down the chain of company to company, word doesn't get to Company D that BOTH their circuits will go down.

[Rogean]

Dear Netriplex Customer,

As you know, Netriplex's Asheville Datacenter (AVL01) suffered a major network outage this morning starting at 12:12 AM Eastern time that lasted for approximately 1.5 hours. *While complete details surrounding this incident are still somewhat unknown due to ongoing conversations with our fiber providers, we take outages of this magnitude extremely seriously. Redundancies are the hallmark of our datacenter architecture, and when they fail, we want to ensure that we do whatever it takes to prevent a similar failure from ever happening again.

We will be holding a public web conference this coming Thursday, October 7, 2010 at 11:00 AM Eastern time (GMT-5). Details for attending this web conference are below, and we encourage concerned parties to attend. We will have a question and answer period at the end of our web conference.

As always, we greatly appreciate your business and will do whatever it takes to ensure we deliver the level of service you expect from a mission critical datacenter.

I'm gonna try to attend.

[Brund the Decrepit]

Woo maybe you can teach them a thing or two Rogean.
Last night was rough. No EQ and Netflix was having trouble with their PS3 streaming video...

[Shannacore]

Netflix was having trouble with their PS3 streaming video...

Netflix on my xbox was being super screwy last night as well, weird!

[Brund the Decrepit]

Netflix on my xbox was being super screwy last night as well, weird!

They must be using Netriplex for hosting too!!!!

Bastards!!

[President]

I'm gonna try to attend.

Might wanna talk to them about daylight savings time considering right now EST is GMT -4.

[rat patrol]

Wondering if anyone knows when the server will be playable again. Not on my server select screen at this point.

[hedbonker]

Wondering if anyone knows when the server will be playable again. Not on my server select screen at this point.

Server is offline for patching right now.

[Cyrius]

Server is up and running.

[Rogean]

Wondering if anyone knows when the server will be playable again. Not on my server select screen at this point.

Reading dates are your friend.