Server Outage

[Rogean]

We have a hardware failure. We're working on it.

[khanable]

<3

[Lytt]

Thanks.

[Tankdan]

</3

[kgallowaypa]

This wasnt a hardware failure... it was a hack by daybreak to force us to progression

[kingbuzzo]

meskala ran sa faskalamaska mooshka meeshka mickey mouse

[jwargod]

rip

[Ranndom]

We have a hardware failure. We're working on it.

You guys didnt hire the SoE rodents as part time generators did you?

[Domisk]

Any eta?

[Bman703]

Thanks for letting us know

[-Catherin-]

#donate

[arsenalpow]

http://stream1.gifsoup.com/view/12753/hamster-wheel-o.gif

get a new hamster

[ergo]

This wasnt a hardware failure... it was a hack by daybreak to force us to progression

This

[Bman703]

We all Deserve fungi Tunics for dying while the server was down

[aloha_brian]

thanks for the update :)

[bunglusu]

We have a hardware failure. We're working on it.

Thank you P99 team for being on it!

[ergo]

We all Deserve fungi Tunics for dying while the server was down

Will accept an AoN or Guise on my shaman.

[Giimi]

Hope you got raid might need them backups.

[cormag]

pras

[AliciaVIP]

On Grey's Anatomy, when the computer failed, a nurse with 3 semesters of computer science fixed the billion dollar brain imaging computer, in less than 1 episode.

Any idea how long P99 might be down?

[Beldan4]

greedy little people, just request a full server repop

[Bboboo]

/salute

[bumnga]

Ok was just zonin.and boom everything is gone:D

[quido]

Velious pushed back to 2016

[Malevz]

The collective will of 100s of people staring at server select will bring the servers back up.

[Shibie]

Is this the end of p99........ Dun Dun DUNNNN

[Symbioticforks]

Shitty server stability is classic.

[Saker]

This wasnt a hardware failure... it was a hack by daybreak to force us to progression

Damn-them! DAMN-them-to-HELL!!! I'm not going! Screw-them!

[SHOWITME]

The collective will of 100s of people staring at server select will bring the servers back up.

ILL PRAS DAT

[Bman703]

.

[bunglusu]

The collective will of 100s of people staring at server select will bring the servers back up.

damn right. i was in the middle of camping a named mob. This server respawn will save me 4 hours!

[mrwynd]

Thank you for your time! #donate

[IceCadaverX]

Aww, I just logged in the first time yesterday and finally got off work to come home and re-live being 15 again.

Hope it's resolved soon. I look forward to playing more! And thank you for creating this server in the first place <3

[Rexin]

Thanks for the update!

[dcbone86]

Will there be a rollback? I was on a boat in OOT and really hope I don't spawn there or have to do a CR on my lvl 4 bard

[oracle333]

Hey, Treeitek. You're that guy who ported Shammawokee to Toxx (he wanted Sro) took his money and then left him there.....

[mytdruid]

Ach, it's extremely important that I farm HQ pelts! =(

[Frudrura]

Holy shit, could it be? I think we were sabotaged.

[Tameth]

going to watch Ex Machina again. pras server down.

[Dacien]

Hardware failure sounds bad. #donate.

[fiveeauxfour]

Treeitek

This dude is a goddamn legend. HUSH

[Bboboo]

Hey, Treeitek. You're that guy who ported Shammawokee to Toxx (he wanted Sro) took his money and then left him there.....

Yes I am.

I also gave him back his money even after he kept disrupting our guild meeting and we told him to wait for a port or find another.

[lavatt]

Time to move to AWS :P

[Wisteso]

Could just be a failed network card / router.

Failed hard drive will be the biggest thing to worry about. Unless they're using raid 4/5 in which case its not that big of a deal.

[Frudrura]

Time to move to AWS :P

What is AWS?

[Maximius]

What is AWS?

Overpriced pixels.

[sh8671]

Could just be a failed network card / router.

Failed hard drive will be the biggest thing to worry about. Unless they're using raid 4/5 in which case its not that big of a deal.

raid 4/5? get out you obv don't know what you're on about.

[Tieral]

Great time to hit the donate button! Good luck guys, and thanks for the update.

[lavatt]

the cloud service that's the easiest to port to with highest availability IMO.

[mrwynd]

Amazon Web Services - aka Amazon's virtual servers.

[Nahilu]

I didnt have time to try out Ragefire Server.... I guess i have now.

[ergo]

the cloud service that's the easiest to port to with highest availability IMO.

The planet/Softlayer/IMB > all

[Wisteso]

AWS would be horrible considering this is non-for-profit. Its very expensive for services that require 99.99% uptime. Self hosting is a lot more cost effective.

[Omnifiend]

Server staff here is amazing. Some games that make millions would take much longer to acknowledge a problem.

[mdavis522]

Im glad they/he cares enough to work on it. Thank you! I can't imagine going back to live if anything happened to p99. I will wait with gratitude.

[Jimjam]

Someone said wipe it clean one too many times...

[Siets]

The real question is: if it was all lost, how many do you think would come back?

I know I'd be right back out there killing rats and bats. :)

[mrwynd]

Server staff here is amazing. Some games that make millions would take much longer to acknowledge a problem.

So true, love P99!

[cormag]

Someone said wipe it clean one too many times...

How bad would people feel if there was a catastrophic hardware failure and all characters were lost. All those years of poopsocking and tunnel-questing just gone

gone

gone

[Frudrura]

I would be minorly upset, if it was a wipe, but, there is only one p99, so I would come back.

[Nuggie]

You can rest assured that your data is safe. Failures can be expensive. #donate

[Kickaha]

This is part of the classic experience - waiting for the server to come back up after a crash and hitting refresh every 10 seconds!

[ALLCAPS]

Is there an ETA by chance? Just got time to log in and within 10 minutes there's a crash.

WHY ME!?

[ergo]

The real question is: if it was all lost, how many do you think would come back?

I know I'd be right back out there killing rats and bats. :)

Training 10 decaying skellies on your face. Run back bish~

[Mordyth]

NNnnnooooo I pulled a "sick day" to play today lol


Looks like ragefal time

[ergo]

How bad would people feel if there was a catastrophic hardware failure and all characters were lost. All those years of poopsocking and tunnel-questing just gone

gone

gone

keep going, more please I'm almost there.

[mrwynd]

Just sent a $10 donation, thank you for your time!!!

[Bboboo]

NNnnnooooo I pulled a "sick day" to play today lol


Looks like ragefal time

Spot the not American.

[Tatu]

Your down time will probably still take less time than the queue to get into the new progression server is taking.

[Jimjam]

How bad would people feel if there was a catastrophic hardware failure and all characters were lost. All those years of poopsocking and tunnel-questing just gone

gone

goneAs someone with severe alt-it is I'd almost be happy to have more character slots again!

[Oleris]

Rogean tried to implement coding to prevent the pirahna's in nektulos from coming out of the water and it broke the server.

[Niamh]

Just sent a $10 donation, thank you for your time!!!
I love this community and that people care enough to do things like this! I plan to do the same once I am able. :)

[kus]

Is there an ETA by chance? Just got time to log in and within 10 minutes there's a crash.

WHY ME!?

So it's your fault?! Damn you, damn you straight to hell!

;-) ;-) ;-)

[Celticgirl]

Thank You to all the P99 staff

[ergo]

Will donate for Guise /imawhoredontcare

[Mordyth]

Spot the not American.

And proud of it mate!

:D

[Wisteso]

I also threw $10 at them. Been playing here a while and while its free for us, hardware + bandwidth + electricity is not, for the server maintainers.

[disenchant]

I wouldn't mind starting over, and I wouldn't have to deal with one person soloing an entire floor of a dungeon wearing 50k in gear on a level 10 toon.

[Barkoviak]

I just downloaded the game 2 hrs ago. Perfect timing.

[Rexin]

Is it really possible to wipe link that? Aren't there backups of backups?

[Jimjam]

You would have to deal with 1000 people trying to fight in the dungeon instead, which could be worse!

[Bman703]

.

[Xulia]

Donating on payday.

[dealicious]

Dont think you can try ragefire cause p99 is down, there is a server cap population on ragefire with over 2h of queue lol!

[ScruffMacBuff]

You would have to deal with 1000 people trying to fight in the dungeon instead, which could be worse!

Well the lesser traveled dungeons would get some traffic because no one would be able to port. So people would be spread out. People may even venture into Runnyeye.

[Aangus]

Haven't donated in a couple months so $30 incoming

[ALLCAPS]

People may even venture into Runnyeye.

Don't be ridiculous.

[seasparroe]

Is the 20 minute pnp still in effect?



Love

[ergo]

Is the 20 minute pnp still in effect?



Love

Always?

[oracle333]

I donated 10 bucks, too. As good a time as any lol.

[Uuruk]

Wipe it clean

[disenchant]

A lot of people would be so disgruntled, they wouldn't be back for a week or so, they may even play WoW for a day...

[mytdruid]

A lot of people would be so disgruntled, they wouldn't be back for a week or so, they may even play WoW for a day...

EWWWWW

[Mordyth]

Might go try one of those other "servers" for a bit

[wormed]

Guys, reboot due to adding of Luclin code.

[Saker]

...shakes are settin in...! Need mah fix! Agh! The withdrawal!!! Just alitttle taste!?!

http://24.media.tumblr.com/b3a6babe41e3c930671d6c1f05745666/tumblr_meyxkrxKxX1qasmuvo1_500.gif

[ergo]

A lot of people would be so disgruntled, they wouldn't be back for a week or so, they may even play WoW for a day...

Maybe classic wow, BC at the latest, but even then, prolly not...

[Colgate]

is this hardware failure at all related to zones on red desynching to the point of being unplayable for 90% of players once more than ~150 people are in the same area?

[ALLCAPS]

=[

[smurfu55]

Donated just now!

[Saker]

Rogean tried to implement coding to prevent the pirahna's in nektulos from coming out of the water and it broke the server.

that's not a bug it's a feature!

[Eindiar]

Please. Please fix the issue. My family is dying. Please.

[Saker]

Server staff here is amazing. Some games that make millions would take much longer to acknowledge a problem.

some of -those- companies never admit to problems let alone mistakes!

[Saker]

Please. Please fix the issue. My family is dying. Please.

IKR!?!

http://1.bp.blogspot.com/-8As51D3ALOk/VKBpUpkHQsI/AAAAAAAAnLA/HOjxdhJ2goo/s1600/581953.gif

[Siets]

Please. Please fix the issue. My family is dying. Please.

[Jimjam]

Please. Please fix the issue. My family is dying. Please.

Like are they desperate to play p1999 or are you taking them hostage?

[Eindiar]

... there's not much time. The antidote is in the blue server; it must be made playable.

[herb_gotti]

Like are they desperate to play p1999 or are you taking them hostage?

both?

[Rogean]

It is an array failure, but nothing is lost. Not even a rollback (We have active replication). But we need to get the database server back up and running. Could be a couple hours folks.

[cormag]

pras

[Tameth]

It is an array failure, but nothing is lost. Not even a rollback (We have active replication). But we need to get the database server back up and running. Could be a couple hours folks.

yikes, send out a batphone when it's up. thanks

[EQJubilee]

This is what they get for trying to block the Luclin models!

[oracle333]

What is an array failure? Just curious.

[Bman703]

.

[Eradication]

The withdraw struggles are real! :eek:

[quido]

Damn that's bad. Velious 2017 you say?

[Jayneweigh]

Thanks for the update Rogean!

[oracle333]

We're getting Luclin models? Why? I like the old models.

[cormag]

What is an array failure? Just curious.

http://en.wikipedia.org/wiki/Disk_array_controller

[Shjade]

It is an array failure, but nothing is lost. Not even a rollback (We have active replication). But we need to get the database server back up and running. Could be a couple hours folks.

Thanks for the update. ^.^

[Grimjaw]

f*** yeah!! Burn that m*****f****** to the ground!

[Eindiar]

the powers at be be like:
http://www.quickmeme.com/img/c1/c188e864e4f5cf7eb18baeee5476ead10e75660f31525319ca 4ab3fccf7b8ff1.jpg

[oracle333]

This is interesting stuff. It's also like reading a whole other language. I'm very stupid when it comes to these things. What's an array failure in simple terms?

[President]

Array failures are generally not a good thing, bad.. really. But good the data isn't lost.

[Erica]

It is an array failure, but nothing is lost. Not even a rollback (We have active replication). But we need to get the database server back up and running. Could be a couple hours folks.

What is the cost of the hardware failure if any?

[Malevz]

It is an array failure, but nothing is lost. Not even a rollback (We have active replication). But we need to get the database server back up and running. Could be a couple hours folks.

Sent a donation. During my non playing time I realized my wife and children moved out, and took the pets, so I'm saving more money on food and such. I was wondering why it had been so quiet for the last year and a half.

[Mordyth]

It is an array failure, but nothing is lost. Not even a rollback (We have active replication). But we need to get the database server back up and running. Could be a couple hours folks.

Were you tempted Rogean? Just a little to make a back up of everything and relanch with a clean slate??

You could have copied it all back again in a few hours and sat back pissing yourself with laughter at all the QQ

[oracle333]

lmao

[Saker]

Sent a donation. During my non playing time I realized my wife and children moved out, and took the pets, so I'm saving more money on food and such. I was wondering why it had been so quiet for the last year and a half.

That post was worth this all, I had a good laugh, thank you! :)

[Shift]

We all Deserve fungi Tunics for dying while the server was down
this sounds fair enough, haha keep us informed , you do a awesome job you guys

unlike DBG and their guild puppets Twisted Legacy on Ragefire Progression server they got that into a clusterbuck, botting,boxing etc such a failure launch.

[Grimjaw]

Could just be a failed network card / router.

Failed hard drive will be the biggest thing to worry about. Unless they're using raid 4/5 in which case its not that big of a deal.

raid 1 best raid

[Tetton]

Thanks for the update and hope to play again soon.

[Abizmla]

Why is this happening to me!?!?!?!

[Saker]

http://weblog.ws/wp-content/plugins/RSSPoster_PRO-PersianScript/cache/b0031_elena-crying-over-damon.gif

[anarch]

Rogean tried to implement coding to prevent the pirahna's in nektulos from coming out of the water and it broke the server.

http://i.imgur.com/OD3sj66.gif

[Swish]

http://data3.whicdn.com/images/115405017/large.jpg

[Lune]

http://i.imgur.com/0wBpM1g.jpg

i need a fix

[Madbad]

I'm trying swish, I'm trying

[Purp]

http://data3.whicdn.com/images/115405017/large.jpg

mind blown

[Wisteso]

Could just be a failed network card / router.

Failed hard drive will be the biggest thing to worry about. Unless they're using raid 4/5 in which case its not that big of a deal.

It is an array failure, but nothing is lost. Not even a rollback (We have active replication). But we need to get the database server back up and running. Could be a couple hours folks.

Called it with the raid4/raid5 thing. He'll probably just need to add a new disk in to replace the bad one (or get a new Raid PCI card if that died)

[Tibbz]

:( but the kids are finally sleeping! :p

[VZ_Xanit K'ven]

http://data3.whicdn.com/images/115405017/large.jpg

lol

[Bardweiser]

It is an array failure, but nothing is lost. Not even a rollback (We have active replication). But we need to get the database server back up and running. Could be a couple hours folks.

In other words things are "LOADING, PLEASE WAIT...." ? ;)

[Grimjaw]

depending on the size of the array, and the raid configuration (1,4,5,etc), usually 1 dead disk wont take down the server. it would take multiple disks to fail before it would take down the server, which gives you a chance to replace failed disks before it has an impact.

[flatpick13]

I appreciate the updates and hard work. Cyber high-five!

[Wisteso]

depending on the size of the array, and the raid configuration (1,4,5,etc), usually 1 dead disk wont take down the server. it would take multiple disks to fail before it would take down the server, which gives you a chance to replace failed disks before it has an impact.

Yep. With raid4/5, one bad disk causes degraded performance but not a total outage.

My guess is the card itself died since the data is still intact according to Rogean. New cards range from 10 to 3000 dollars. #donate

http://www.newegg.com/Product/Product.aspx?Item=N82E16816124009 low end
http://www.newegg.com/Product/Product.aspx?Item=9SIA67S2FB5169 higher end
http://www.newegg.com/Product/Product.aspx?Item=9SIA67S2985740 enterprise end

If he can find an exact replacement, should be back up tonight. If he needs a different model, might take half a day.

[mattrc]

Or it could be like the server where I work where nobody noticed the nagging alert that a disk had failed in a raid 5 array until a second disk in that array also failed. (about 1 year after the first failure)

However, since there's no data loss I'll go with the 'failed card' guess.

[NotBadForAHuman]

Why is this happening to me!?!?!?!

Pshh don't be such a baby Cameron.

[beta]

http://i.imgur.com/0wBpM1g.jpg

i need a fix

Lol

[Abizmla]

Pshh don't be such a baby Cameron.

Nuuuu plzzz.

I need this.

[giesler79]

Raid array isnt the issue from Rogean (sp) post. Its the DB server. Swapping in a new disk into a raid 5 setup is trivial. May wanna just call it a night and log in tomorrow =)

[NotBadForAHuman]

But I am supremely impressed that people's first response to a server failure and lost play time is donation and supportive words. Pras p99. Pras.

[bunglusu]

Project 1999 Red appeared in my sever selection screen for a few minutes!!!!

[Feanol]

A disk array controller is a device which manages the physical disk drives and presents them to the computer as logical units. It almost always implements hardware RAID, thus it is sometimes referred to as RAID controller. It also often provides additional disk cache.

Wikipedia makes it pretty clear. This device Rogean is fighting with is capable of controlling our RAIDs. That's why they call it a RAID controller.

Already sad I can't RAID.

[Genedin]

GOOD LUCK SIRE!

[TheLuckyX1]

Good Luck! I hope things get better! You are doing a great job! :)

[dealicious]

Wikipedia makes it pretty clear. This device Rogean is fighting with is capable of controlling our RAIDs. That's why they call it a RAID controller.

Already sad I can't RAID.

LOL! Thx for this, you made my night :)

[Skinnah]

Will be donating payday!

[Wisteso]

Raid array isnt the issue from Rogean (sp) post. Its the DB server. Swapping in a new disk into a raid 5 setup is trivial. May wanna just call it a night and log in tomorrow =)

It is an array failure, but nothing is lost. Not even a rollback (We have active replication). But we need to get the database server back up and running. Could be a couple hours folks.

If he's relying on replication, I guess that means the disks suffered unrecoverable corruption? Not using raid 4/5 I guess, if they have replication? The odds of two disks failing together are pretty small.

[wiseguy3k]

It is an array failure, but nothing is lost. Not even a rollback (We have active replication). But we need to get the database server back up and running. Could be a couple hours folks.

Experience has shown that estimates regarding repair time for computer technology is similar to converting °C to °F.

Double it and add 30.

Rooting for a quick recovery!

[Shift]

I just donated 40 bones to you gentlemen of Project 1999 we believe in you.

God Bless

[Saker]

Raid array isnt the issue from Rogean (sp) post. Its the DB server. Swapping in a new disk into a raid 5 setup is trivial. May wanna just call it a night and log in tomorrow =)

You're clearly insane!

https://p.gr-assets.com/540x540/fit/hostedimages/1386008051/7273853.gif

[nyclin]

Gotta wonder what the IO/net trends look like for the Forums server over the past 6 hours. Does it compare to the Fappening?

[sdsawatzky]

Sent a donation. During my non playing time I realized my wife and children moved out, and took the pets, so I'm saving more money on food and such. I was wondering why it had been so quiet for the last year and a half.

I don't get why people are finding this funny... if she had have played the game he would have noticed.

[President]

If he's relying on replication, I guess that means the disks suffered unrecoverable corruption? Not using raid 4/5 I guess, if they have replication? The odds of two disks failing together are pretty small.

Replication means one database server is reading the logs of another database server and replicating itself to be the same, usually a handful of seconds behind. That should mean they have a database server still good to go, but it can be a lot of work to bring an application up on the replicated database, plus the risks associated.

[Khoren Stonefall]

I took the time to donate during the downtime. That this thread is so positive says a lot about the P99 community! I love it here.

[Faited]

Replication means one database server is reading the logs of another database server and replicating itself to be the same, usually a handful of seconds behind. That should mean they have a database server still good to go, but it can be a lot of work to bring an application up on the replicated database, plus the risks associated.

This!
Thanks for all your hard work p99 staff. We're bearing with you & bringing gifts via donations.

[StrangerComesKnocking]

Donated 60.00

__________________________________________________ ______________________Wickedjester level 48 Ogre shaman
Incursion level 42 Iksar necromancer

[Aangus]

Once I had a drive fail in a raid 5 and while replacing it another went taking down everything. Rare but it can happen. Then I went to an active hot spare on top of the raid.

[LoliPops]

http://vadercoaster.ytmnd.com/

[Dillian]

This wasnt a hardware failure... it was a hack by daybreak to force us to progression Force us? hell i cant even log in to them. its always to damn full

[flatpick13]

For some reason, when I sign in now, my quick connect server has defaulted to "[R]BillyMaysHere"....

[cchaplin1985]

All good. I got a decent day in today. Hope to see you all tomorrow!

[Tpar]

The staff of P1999 is Fantastic! I've donated! This FREE source of entertainment is matched nowhere else! If you haven't donated, please do so soon!

Cpt. Aceart Earthbender
Blackheart Pirates - Project 1999
Commanding

[slowpoke68]

Just started playing a couple of weeks ago, but love it. Thanks so much for all the hard work. Now is as good a time as any to make that donation I have been meaning to get around to.


edit

Since it is a donation I can write this off right! :)

[Gibbyfest420]

Where can i donate I do not see a donate link, I would like to donate.

[Tpar]

Where can i donate I do not see a donate link, I would like to donate.

Main page, scroll over, and down a bit.
Click on the Paypal button that says Donate.

[mrwynd]

https://www.project1999.com/index.php?pageid=donations

[Eindiar]

pleeeeeease let us play!
http://cdn.meme.am/images/300x/5621082.jpg

[DreggsOfSociety]

For some reason, when I sign in now, my quick connect server has defaulted to "[R]BillyMaysHere"....

It's because your default server wasn't available when you tried to log in. It will change back after you log back into the p1999 server.

[ScruffMacBuff]

It's official. They gambled and won. They shut it down on purpose hoping we would all go and donate instead of flaming.

[Grizzl]

http://www.adrc.com/raid_failure_types.html

[Stivik Polanski]

Moo!

[ergo]

Just play this and wait with me~

https://www.youtube.com/watch?v=kxopViU98Xo

[Trollhide]

The feels when your favorite game goes down on the last day of a long weekend preceding a particularly shitty week at work. Ordinarily I would rage impotently, but instead I throw money at my problems!

Go team P99!

[Kyzoku]

I don't know what else to do with my time. I remember liking vaginas but only vaguely.

[Vexall]

I support your cause gentlemen. $100 plats in RLM. Keep up the good work!

Confirmation number: 26T3842399446513C

[Trollhide]

I don't know what else to do with my time. I remember liking vaginas but only vaguely.
EQ >>>>>>>> vaginas > other things

[Gibbyfest420]

Donated ! thanks Project 1999

[cormag]

I took a shower and shaved

[Eindiar]

I drank water and even had some food.

[Portasaurus]

I don't know what else to do with my time. I remember liking vaginas but only vaguely.

This is so gold.

[Thunderjunky]

Donated in appreciation for those that are spending their free time fixing my hobby.

[Shift]

The only time it will fail is when two disks failed simultaneously but such probability is one in a million! As a result, one may tend to believe that RAID can not fail.

The reality: RAID fails

In reality and to the surprise of most, RAID could fail and often fail. See some typical scenario below :
Scenario 1:
When one hard disk fails, very often, there is no hot standby. As a result, the raid array is running on degraded mode. While waiting for the replacement drive which may take a day or two, the likelihood of next drive failure disabling the raid volume is very high. It is reasonable to assume that all the drives in the array are from the same batch and subject to equal amount of working stress. So if one disk fails, the other is also near imminent failure and it often does.


Scenario 2:
Most raid server has a single controller. Its failure will result in catastrophic single point of failure.


Scenario 3:
Frequently, due to power surge, the controller or a number of disk elements could fail resulting in total loss of data. It is also found that a power surge may corrupt the RAID configuration setting of NVRAM in the controller card.


Scenario 4:
It is also commonly found that while replacing a faulty drive in an attempt to rebuild the raid volume to healthy state, wrong procedures are performed resulting in wrong or partial rebuild, or complete system breakdown upon completion of rebuild.


Scenario 5:
Not to forget that a RAID configuration with fault tolerance at best only intends to protect the physical failure, but not logical corruption such as system corruption, virus infection, or inadvertent deletion.


Types Of RAID failures

To summarize, RAID server often fails as a result of the following situations and frequently, a combination of them :
Malfunctioned Controller Missing RAID partition Power Surge
Data Deletion or reformat Virus Attack Inadvertent reconfiguration of RAID volume
Raid rebuild error or volume reconstruction problem
Multiple disk failure in off-line state resulting in loss of RAID volume
Wrong replacement of good disk element belonging to a working raid volume
Loss of RAID disk access after system or application upgrade
Loss of RAID configuration settings or system registry

In case you have a RAID server failure, you may want to read the emergency RAID Rescue guide before sending the disk to us for data recovery.

ouch that could cause a server wipe cleaned. just gotta be gentle with her. if it does I am not bother i will just start from a clean slate

I donated the 40 for that reason reset the server then we all can race for xp and have fun together like the olden days.
But I really just donated because I love this server and the people that who run it, and the people who are in it.

I Love you man, I don't care man you are not getting my bud light.
LOL

Thanks Sincerely, Kishift Inggears GL of The Elite

[Eptar]

Now that daybreak has officially acknowledged p99, can they start actively soliciting donations?

[Farzo]

Now that daybreak has officially acknowledged p99, can they start actively soliciting donations?

pay2win?

[anarch]

http://i.imgur.com/Yr99v6f.gif
Just put in a $10. Do it!

[roush420]

PLZ, roegan, bring back red99 to online status so i can go finish leveling up!! lol gotta hit 60 before velious launches$$ And thanks to all the admin for keeping this version of EQ going!! much appreciated.

[dafier]

It is an array failure, but nothing is lost. Not even a rollback (We have active replication). But we need to get the database server back up and running. Could be a couple hours folks.

Just trying to help....

DB integrity check before taxing is always the last step before I allow active connections.

And, for all your unknowing out there. The DB failure due to HDD loss for the most part isn't a complete loss especially when you have in/active redundancy. To fix it though take hours of clicking, and waiting for verification type checks. Sounds like whoever does your DB admin stuff knows what they are doing.

Thanks again P99 team.

[Rogean]

We have the physical server back up and we're working on restoring data. Looking at possibly 12 to 1 AM ETA.*

Rough guess estimate. Could be delayed

[serjiazazel]

Thanks for all you do P99 Team.

[Nexii]

Great news. I just wanted to say I also chipped in $10.

[Voland]

It's official. They gambled and won. They shut it down on purpose hoping we would all go and donate instead of flaming.

It's working! I just donated too.

[Pinolian]

I donated again too, these guys deserve it.

[Voland]

Just play this and wait with me~

https://www.youtube.com/watch?v=kxopViU98Xo

Hey, that's actually pretty cool!
I wonder what original song this was ripped from.

[kierra]

thanks for the update! I guess its bed time for this little rogue then =)

[bunglusu]

We have the physical server back up and we're working on restoring data. Looking at possibly 12 to 1 AM ETA.*

Rough guess estimate. Could be delayed

What time zone?

[Terroir]

Quick, I hear donating more will get it done faster.

No, but seriously, donate what you can.

[Gibbyfest420]

what time zone

[contemptor]

What time zone?
He's EST

[PhillGiroux]

I heard donations make the server gods happy, so I gave them a few more monies.

[Valerik]

Rogean thanks for pulling overtime man. <3

http://i.imgur.com/os6eOcc.jpg

[Eindiar]

Absence makes the ❤️ grow fonder.

[Eradication]

Thanks for the update. Good work on fixing it :D

[golten]

On Grey's Anatomy, when the computer failed, a nurse with 3 semesters of computer science fixed the billion dollar brain imaging computer, in less than 1 episode.

Any idea how long P99 might be down?

Hey! she was a semimain character though! good ol' rose, the throwback ho-back

[dirtynumbangel333]

I'm patient.

[Grivyn]

1-3 hours if TZ is EST

[golten]

51 sk lfg!

[Brock101]

Man for us fathers this blows, get on to pumpulate for a bit after the kids go to bed and boom nocked back down lol.

Although this is the best server of eq since 16 years ago that I still have the evercrack love for, sure hope it's up soon! Thank you very much staff for enabling me and many others to relive a dream!

[ScruffMacBuff]

I wish I had been in UGuk when the server crashed so I could have a chance at getting the AC camp.

[Malevz]

Still way less downtime than live had during this era

[ergo]

Still way less downtime than live had during this era

This.

[chunkluv]

This is an outrage!! I don't pay $15 a month to have to.... oh, wait, never mind. Take your time, thanks for all that you do!

/donate

[Brock101]

This is an outrage!! I don't pay $15 a month to have to.... oh, wait, never mind. Take your time, thanks for all that you do!

/donate

Exactly my thought

[Bman703]

.

[Lojik]

It seems like there are a lot of comments along the lines of "just donated...appreciate all you [server staff] do for us" anytime the servers are down. I wonder if there's a strong spike in donations during server outages.../tinfoil

[mallgair]

But I see people auctioning stuff?

[fred schnarf]

It seems like there are a lot of comments along the lines of "just donated...appreciate all you [server staff] do for us" anytime the servers are down. I wonder if there's a strong spike in donations during server outages.../tinfoil

there always is

and they aren't going into the server, datacenter or anything p99 related either

[golten]

no matter how many times i view this, the servers dont come back up!!!

[golten]

im angry with nowhere to vent my rage, and no CC to throw money at my woes....

What am i to do i ask you?!?!

[dafier]

WOOO! Just logged in!

[Voland]

WOOO! Just logged in!

For real? I still don't see p99 in the server list.

[bunglusu]

WOOO! Just logged in!

Troll

[Zoth]

Yup not on mine either.

[Stivik Polanski]

WOOO! Just logged in!

Pish posh!

[disenchant]

Tomorrow

[tripee]

WOOO! Just logged in!

http://i.imgur.com/I0tS4pB.jpg

[keysmash]

Troll

To be fair, he didn't say what he logged into.

[GeinHealy]

It is an array failure, but nothing is lost. Not even a rollback (We have active replication). But we need to get the database server back up and running. Could be a couple hours folks.

OMG! I just have to say it: "This is NOT classic! No it's NOT!"

YOU are 1000% times better than the entire Sony Verant Yhadda Yhadda megaCorporation(s)!!

Thank you. You're AWESOME!

[Grevenillvec]

https://www.youtube.com/watch?v=W6GDil0rGls

[Faited]

get on to pumpulate for a bit after the kids go to bed and boom nocked back down lol.

I think we have a difference of opinion here. Cuz my version of PUMP-U-LATE involves a sexy lady with no computer game in sight! ;)

[jakedubbleya]

#donate

:D

[Brock101]

I think we have a difference of opinion here. Cuz my version of PUMP-U-LATE involves a sexy lady with no computer game in sight! ;)

If you where in my group of friends 16 years ago with our inside jokes you would understand lol

[Lisset]

WOOO! Just logged in!

I never understood the humor in this kind of trolling.

"HAHAHA!! You gave me the benefit of the doubt and didn't assume I'm a liar!"

[Feriss_Weal]

Rogean mutters to himself as he fixes the server:

"Hmm, which disk ruined the raid ... let's see a Maxtor, Seagate, Western Digital, Jenkins, Seag ... F*CK!"

[Enderenter]

there always is

and they aren't going into the server, datacenter or anything p99 related either

Who cares what the donations go towards, its none of our business, these guys are working to get the server back up on a holiday and the server is free to play.

[georgie]

not srs

[Lisset]

OMG! I just have to say it: "This is NOT classic! No it's NOT!"

YOU are 1000% times better than the entire Sony Verant Yhadda Yhadda megaCorporation(s)!!

Thank you. You're AWESOME!

In order for it to be classic, it should have been brought up already and then crashed after 40 minutes, allowing the false sense of security, CR's to be mostly completed and raids resumed. This would need to be followed by the same thing at least one more time. And then a 7-12 hour delay the next day.

[ergo]

OI, make me some resist jewelry!

[pink grapefruit]

Thanks for your hard work, Rogean and team.