PDA

View Full Version : So I wrote an EQ Server population parser... here's some data !


xious
01-18-2013, 08:06 PM
EDIT
Data is now available directly on http://p1999.dmsimard.com

I was curious to see what kind of population statistics I could pull from the client side, so I went away and made a server population parser script.
Obviously, this could have been done far easier from the server side but I don't happen to have that sort of access :P

At the time I've ran my "snapshot" for data, there were 699 players online and my parser was able to find and identify 440 characters. (Friday January 18th at 4:45PM EST)
This means that 259 characters were either /Anonymous or on /Roleplay.

Please excuse me, I'm bad with graphs and charts, but here's some data.
If someone wants to use the raw parsed data to make some awesome charts, let me know and I'll give it to you :)


shaman: 48
druid: 45
necromancer: 42
warrior: 41
monk: 39
enchanter: 38
cleric: 36
magician: 33
shadowknight: 28
bard: 26
rogue: 22
wizard: 18
paladin: 13
ranger: 13



1: 13
2: 7
3: 11
4: 10
5: 10
6: 10
7: 14
8: 10
9: 13
10: 7
11: 8
12: 11
13: 6
14: 10
15: 7
16: 9
17: 8
18: 11
19: 10
20: 11
21: 5
22: 4
23: 3
24: 5
25: 5
26: 1
27: 3
28: 8
29: 5
30: 12
31: 4
32: 3
33: 3
34: 7
35: 7
36: 5
37: 1
38: 8
39: 7
40: 5
41: 3
42: 5
43: 5
44: 2
45: 1
46: 4
47: 1
48: 2
49: 4
50: 5
51: 12
52: 9
53: 8
54: 7
55: 17
56: 13
57: 8
58: 7
59: 9
60: 23



Dark Elf: 52
Human: 51
Iksar: 48
Wood Elf: 47
High Elf: 36
Gnome: 35
Halfling: 31
Dwarf: 28
Ogre: 27
Troll: 25
Half Elf: 24
Barbarian: 21
Erudite: 17



None 243
Europa 28
Full Circle 21
Peace Pipe 14
Knights Who Say Ni 13
Bregan D`Aerth 11
The Mystical Order 11
Asgard 9
Forceful Entry 9
Taken 8
Divinity 7
Honor Face 6
Azure Guard 5
Flawless Victory 5
Swampwater Taffy 5
Prophecy 4
The Night's Watch 4
Amicus Ignis 3
Arcadia 3
Ardness 2
Carpe Noctem 2
Free Raiders 2
LFG Puma Group 2
Lost Sock Patrol 2
Mari Kita 2
Of Tholuxe Paells 2
Shipwrecked 2
The A-Team 2
The Pride 2
Dark Ascension 1
Dark Twilight 1
Dream Tribe 1
Fashionably Late 1
Freedom Guard 1
Go Team Good Guys 1
Kusemites 1
Loading Please Wait 1
One Man Wolfpack 1
Order of the White Rose 1
Scars of Insanity 1
Sunnyvale 1
The Dark Exile 1
Together As One 1



ecommons 77
sebilis 20
fearplane 17
gfaydark 15
karnor 15
lakeofillomen 14
unrest 14
crushbone 13
overthere 13
guktop 12
Loading 11
butcher 10
frontiermtns 10
fieldofbone 9
gukbottom 9
oasis 9
soldungb 9
citymist 8
misty 7
southkarana 7
mistmoore 6
commons 5
highpass 5
qeytoqrg 5
steamfont 5
trakanon 5
everfrost 4
freportw 4
innothule 4
kithicor 4
nektulos 4
oot 4
qeynos2 4
warslikswood 4
blackburrow 3
burningwood 3
charasis 3
dreadlands 3
droga 3
eastkarana 3
firiona 3
freporte 3
freportn 3
kaesora 3
lavastorm 3
neriakb 3
nro 3
paw 3
cabeast 2
cauldron 2
feerrott 2
kurn 2
northkarana 2
oggok 2
qeynos 2
rathemtn 2
soldunga 2
sro 2
timorous 2
cabwest 1
erudsxing 1
felwithea 1
felwitheb 1
grobb 1
hateplane 1
highkeep 1
hole 1
kaladima 1
lakerathe 1
lfaydark 1
najena 1
neriaka 1
neriakc 1
paineel 1
rivervale 1
tox 1

Swish
01-18-2013, 08:17 PM
Nice, would be good to see a comparison versus peak time.

Also don't forget a "/who all count" can list with anons included, for example "/who all iksar count"

xious
01-18-2013, 08:27 PM
Nice, would be good to see a comparison versus peak time.

Also don't forget a "/who all count" can list with anons included, for example "/who all iksar count"

Ooooh, I didn't even know about the count command.. I'll check that some time soon.

Lyra
01-18-2013, 08:34 PM
This was interesting. I would like to see lots of them, date stamped.

Thanks for doing this.

Silo69
01-18-2013, 09:51 PM
looks like since everyone has had there slice of the eq pie... over time the SOV class power shift is about to adjust itself according

i see monks shaman slowing moving up to #1 #2 in terms of most powerful classes with the raid utility classes adjusting themselves as well

really surprised about the rogue/wiz both about on par if not this server should be endgame rogue heavy, but its not

primal rogues... goo goo gah gah not broken but sustained dps zzzzzzzzzzzzzzzzzzzz /faceroll

Silo69
01-18-2013, 09:58 PM
recognizing patters

i notice every 10 lvls after the 1st 2... it drops off significantly and 40+ people start to become more dedicated or "main" reroll more.

so a healthy noob population atm from lvls 1-10, server growth

10-20 also healthy

55-57 lol.. standard most people cant make that hump from 56-59 because its just uggggggghhh, you start to re evaluate if your gonna make this your "main", "Main".

Nice log, i do something similar but on a smaller scale for what i could consider "competitive players in my bracket or classes however your ego justifies it.

ty

SamwiseRed
01-18-2013, 10:03 PM
there was 99 shammies on when pop was 900+. i was playing my shammy at the time and I no longer felt special knowing there was 100 others out there canni dancing :(

Silo69
01-18-2013, 10:20 PM
over 30 players 22-34...

highkeep: 1

you are doing it wrong, best zone in lvl for that bracket, plenty of "mobs" for x3 full parties if you dont mind faction and will kill guards... best zem you will find with a banker in zone and a merchant that will sell to ANY race/class regardless of

SamwiseRed
01-18-2013, 10:44 PM
over 30 players 22-34...

highkeep: 1

you are doing it wrong, best zone in lvl for that bracket, plenty of "mobs" for x3 full parties if you dont mind faction and will kill guards... best zem you will find with a banker in zone and a merchant that will sell to ANY race/class regardless of

haha no joke man. on live highkeep was da place to be. here its unrest-MM. ill admit EQ emu has converted me to unrest>mm but highkeep will always be my favorite leveling spot of all time.

Llodd
01-18-2013, 10:53 PM
haha no joke man. on live highkeep was da place to be. here its unrest-MM. ill admit EQ emu has converted me to unrest>mm but highkeep will always be my favorite leveling spot of all time.

tbh, I'm just thinking shut the fuck up

SamwiseRed
01-18-2013, 11:03 PM
damn bro, you bluebies get upset over everything lol might wanna re-evaluate your life , sounds like its no where near thriving.

Swish
01-18-2013, 11:29 PM
Llodd and Sam in cahoots for the chance for Sam to say the above ^

xious
01-19-2013, 05:19 PM
This was interesting. I would like to see lots of them, date stamped.

Thanks for doing this.

Actually what I might just do is have a local database so I can do snapshots and just update character records if I see them more than once.
More accurate information this way, IMO, and I'll eventually end up getting most if not all characters eventually as I do my daily snapshots :)

xious
01-19-2013, 06:09 PM
Here is today's data as of 4:45PM EST!
Yesterday's data (also snapshotted at 4:45PM EST) is available here (http://www.project1999.org/forums/showpost.php?p=818095&postcount=1).

Players online: 854
Players Identified: 536
Players anonymous/roleplay: 318


monk 60
necromancer 60
druid 59
warrior 52
shaman 48
bard 46
enchanter 44
cleric 38
shadowknight 30
magician 28
wizard 23
rogue 19
paladin 15
ranger 14



1 16
2 8
3 7
4 17
5 12
6 11
7 20
8 11
9 12
10 15
11 8
12 7
13 10
14 17
15 14
16 11
17 9
18 7
19 13
20 6
21 9
22 9
23 5
24 7
25 5
26 6
27 4
28 4
29 7
30 12
31 5
32 5
33 10
34 5
35 9
36 6
37 5
38 4
39 6
40 9
41 4
42 7
43 2
44 4
45 6
46 3
47 6
48 2
49 2
50 6
51 9
52 20
53 10
54 13
55 10
56 17
57 11
58 7
59 11
60 23



Human 68
Iksar 68
Dark Elf 57
Wood Elf 57
High Elf 48
Halfling 41
Gnome 34
Half Elf 34
Erudite 30
Ogre 29
Barbarian 26
Dwarf 26
Troll 18



None 325
Bregan D`Aerth 21
Full Circle 20
Asgard 14
Europa 14
Knights Who Say Ni 13
Taken 13
Divinity 12
The Mystical Order 11
Swampwater Taffy 9
Azure Guard 8
Arcadia 7
Kusemites 7
Forceful Entry 5
Peace Pipe 5
Flawless Victory 4
Of Tholuxe Paells 4
Ardness 3
Carpe Noctem 3
Honor Face 3
Sunnyvale 3
The Dark Exile 3
LFG Puma Group 2
Sacred Fyre 2
Shipwrecked 2
The Pride 2
Bloodline of Eld 1
Dark Twilight 1
Dream Tribe 1
Evoluxa 1
Fashionably Late 1
Free Raiders 1
Freedom Guard 1
Go Team Good Guys 1
Inglourious Basterds 1
Katximba Oscura 1
Loading Please Wait 1
Lost Sock Patrol 1
Mari Kita 1
Norrath's Curse 1
One Man Wolfpack 1
Prophecy 1
Signum Lumen 1
The A-Team 1
The Warlords 1
Together As One 1
Triality 1



ecommons 85
gfaydark 30
oasis 25
fieldofbone 23
overthere 21
karnor 19
sebilis 16
nro 14
unrest 13
"Loading" 11
citymist 11
charasis 10
gukbottom 10
southkarana 10
guktop 9
lakeofillomen 9
nektulos 9
blackburrow 8
eastkarana 8
mistmoore 8
oot 8
steamfont 8
crushbone 7
dreadlands 7
frontiermtns 7
misty 7
soldungb 7
butcher 6
everfrost 6
highkeep 6
qey2hh1 6
timorous 6
oggok 5
paw 5
rathemtn 5
warslikswood 5
burningwood 4
commons 4
firiona 4
freportw 4
hole 4
najena 4
soldunga 4
cabeast 3
freportn 3
innothule 3
lfaydark 3
qeynos2 3
qeytoqrg 3
tox 3
trakanon 3
droga 2
felwithea 2
kedge 2
lavastorm 2
northkarana 2
airplane 1
akanon 1
beholder 1
cabwest 1
cauldron 1
chardok 1
emeraldjungle 1
erudnint 1
feerrott 1
felwitheb 1
freporte 1
halas 1
highpass 1
kaesora 1
kaladimb 1
kithicor 1
kurn 1
neriaka 1
neriakc 1
permafrost 1
qeynos 1
rivervale 1
skyfire 1
swampofnohope 1

stormlord
01-19-2013, 07:04 PM
Any idea what level the anonymous are?

I wonder what the average level of the total playerbase is?

Like the parse.

Assuming an equal spread of zones for each level tier then I would say that some level ranges are weak, particularly between 40 and 50. It's hard to say, though. You have to add up all the zones per level range and then compare to the population listed here. If an average zone can supply for X players then you can see whether there's congestion. Too much congestion means the population is too high. I don't think this server will see any of that, though. Nothing like on live where there were twice as many people at least.

With the kunark expansion I think ti's safe to say there's lots of content 30+. But with the thin population in the mid-range must be a tough haul for anybody outside the popular zone(s).

However, the anonymous figure brings some unknown into this.

One of hte problems EQ had later on was too many zones spreading out the playerbase. Classic + Kunark + Velious + Luclin is a LOT of 30+ content. And some new players went to luclin zones. You can imagine that when luclin first released, there were hundreds of thousands of vah shir alts and new characters made.

The company solved that with gloomingdeep + luclin spires + pok books + tss + hotzones + etc. I in fact read a developer chat where they mentioned this exact issue and had stated the numbers they wanted.

Thulack
01-19-2013, 07:22 PM
So many druids. Just think of the % of the Anon players that are druids. Probably the class along with wizzy that would anon. Can't say much though as i am one of them too :P

Vladesch
01-19-2013, 07:49 PM
Nice work.

Unfortunately due to anon these results get skewed against certain classes. Clerics, druid, enchanters are probably more anonymous than the other classes because of rez,port and clarity respectively.

xious
01-19-2013, 08:39 PM
Nice work.

Unfortunately due to anon these results get skewed against certain classes. Clerics, druid, enchanters are probably more anonymous than the other classes because of rez,port and clarity respectively.

I'm working on the database backend to be able to synchronize daily snapshots right now.

When that is done, I will make another set of data that contains server totals at the time of the snapshot.

E.g, maybe the parser can identify 60 monks but if "/who all monk count" shows 80, I know that there are 20 anonymous or roleplay monks.

Eh, it's fun doing this :D

SamwiseRed
01-19-2013, 09:46 PM
/who all druid count will count anonymous too as for any class with that command.

xious
01-20-2013, 01:40 AM
Whew, I've finished the database backend to synchronize the snapshots.

I'll do a couple of snapshots per day and I believe that within a few days I should have a good idea of what the server population really looks like :)

I'll report back later !

Edit: After synchronizing just a second snapshot, already have a database of 944 characters :)

curtischoy
01-20-2013, 02:58 AM
Very cool, very very cool.

Rasah
01-20-2013, 12:49 PM
So many druids. Just think of the % of the Anon players that are druids. Probably the class along with wizzy that would anon.
I have both a druid and a wizard. I keep the druid on /anon, but the wizard I don't. I don't mind the constant port requests so much. But on the druid it's the constant "PL me" or "dump all your mana buffing me" nonsense that gets old.

xious
01-20-2013, 06:30 PM
Okay, this is getting interesting and also so much easier to work with once it's inside a database.

From doing several snapshots since yesterday, I now have a database of 1420 characters. Snapshots were taken both at peak times but also in the morning and in the evening.

Note: I haven't yet added in a second set of data with "/who all count" numbers, this will come later. So that means I was able to identify 1420 players that were not /roleplay or /anonymous.


druid 157
necromancer 147
monk 145
shaman 141
enchanter 127
cleric 112
warrior 111
magician 80
bard 79
rogue 77
shadowknight 77
wizard 58
paladin 57
ranger 48



1 46
2 25
3 32
4 33
5 35
6 31
7 42
8 42
9 32
10 43
11 25
12 18
13 24
14 34
15 37
16 24
17 25
18 25
19 23
20 30
21 24
22 18
23 17
24 18
25 11
26 14
27 18
28 15
29 12
30 29
31 14
32 15
33 12
34 16
35 28
36 10
37 14
38 15
39 18
40 19
41 15
42 12
43 8
44 7
45 21
46 11
47 10
48 7
49 13
50 15
51 30
52 37
53 26
54 27
55 35
56 28
57 21
58 24
59 22
60 84



Iksar 172
Human 170
"Dark Elf" 169
"Wood Elf" 144
"High Elf" 121
Halfling 107
"Half Elf" 88
Gnome 83
Barbarian 83
Dwarf 81
Erudite 77
Ogre 69
Troll 52


None 833
"Bregan D`Aerth" 64
"Full Circle" 55
"The Mystical Order" 41
Europa 39
Asgard 30
"Azure Guard" 29
Divinity 29
"Peace Pipe" 24
"Knights Who Say Ni" 21
Taken 20
Arcadia 20
"Flawless Victory" 18
"Swampwater Taffy" 13
Shipwrecked 12
Kusemites 11
Sunnyvale 10
"Forceful Entry" 10
"Role Playing Guild" 8
"Of Tholuxe Paells" 7
"Honor Face" 7
"The A-Team" 7
Ascendancy 6
"Mari Kita" 6
"Carpe Noctem" 6
"Amicus Ignis" 5
Ardness 5
"Free Raiders" 5
"The Pride" 4
UNKNOWN 4
"The Dark Exile" 4
"Prophetic Descent" 4
"The Night's Watch" 4
Prophecy 4
"Sacred Grove" 4
"LFG Puma Group" 3
"Freedom Guard" 3
"The Warlords" 3
"Go Team Good Guys" 2
"Scars of Insanity" 2
Lads 2
"Sacred Fyre" 2
"Eternal Rancor" 2
"Lost Sock Patrol" 2
Chaos 2
"Prestige Worldwide" 2
"Signum Lumen" 1
Maelstrom 1
"Norrath's Curse" 1
Mischief 1
"Order of the White Rose" 1
Triality 1
"All Day" 1
"Loading Please Wait" 1
LifeAlert 1
Poison 1
"Utopia Project" 1
"Bloodline of Eld" 1
"Inglourious Basterds" 1
"Fashionably Late" 1
"Dark Twilight" 1
Intolerant 1
Nightmare 1
"Katximba Oscura" 1
Darkwind 1
"Vesica Dei" 1
"Together As One" 1
"Secret Of Mana" 1
Evoluxa 1
"One Man Wolfpack" 1
Reclamation 1
"Dream Tribe" 1


ecommons 229
gfaydark 66
unrest 56
karnor 55
oasis 53
overthere 46
mistmoore 40
sebilis 40
fieldofbone 39
"Loading" 34
crushbone 33
nektulos 28
citymist 28
southkarana 26
lakeofillomen 26
nro 25
gukbottom 22
dreadlands 21
butcher 20
guktop 20
frontiermtns 19
commons 19
oot 19
airplane 19
steamfont 18
charasis 17
freportw 15
blackburrow 15
kurn 14
kaesora 14
soldungb 13
rathemtn 13
highkeep 13
everfrost 13
warslikswood 13
timorous 12
qeynos2 11
cabeast 11
misty 11
qeytoqrg 10
trakanon 9
freportn 9
eastkarana 9
lfaydark 8
fearplane 8
northkarana 8
qey2hh1 8
firiona 8
lavastorm 7
veeshan 7
neriaka 7
qeynos 7
innothule 7
highpass 6
sro 6
paw 5
soldunga 4
neriakc 4
tox 4
neriakb 4
cauldron 4
kedge 4
halas 4
permafrost 4
felwithea 4
droga 4
najena 4
freporte 4
rivervale 3
oggok 3
hole 3
erudsxing 3
burningwood 3
skyfire 3
paineel 3
feerrott 3
erudnext 3
lakerathe 3
kithicor 2
qcat 2
kaladimb 2
befallen 2
beholder 2
swampofnohope 2
cabwest 1
emeraldjungle 1
cazicthule 1
erudnint 1
grobb 1
chardok 1
dalnir 1
hateplane 1
qrg 1
akanon 1
soltemple 1

SamwiseRed
01-20-2013, 06:49 PM
hey bro, mind logging on red every now and then and get the numbers for that server too? nb4 someone says 20 person server lol

Safon
01-20-2013, 07:17 PM
hey bro, mind logging on red every now and then and get the numbers for that server too? nb4 someone says 20 person server lol

You use the term "person" generously

xious
01-20-2013, 07:36 PM
hey bro, mind logging on red every now and then and get the numbers for that server too? nb4 someone says 20 person server lol

Yeah, I guess it doesnt take a lot of effort to do that - I don't want to start doing a survey of a dozen servers, though :P

I'll do a couple snapshots when I think about it this week and report back when I have sufficient data.

SamwiseRed
01-20-2013, 07:47 PM
Yeah, I guess it doesnt take a lot of effort to do that - I don't want to start doing a survey of a dozen servers, though :P

I'll do a couple snapshots when I think about it this week and report back when I have sufficient data.

thanks pal.

Shinko
01-20-2013, 08:15 PM
"Forceful Entry" 10

zerg guild

Tecmos Deception
01-20-2013, 08:49 PM
Wouldn't ya know it? Not a single person was in kerra isle.

SamwiseRed
01-20-2013, 08:50 PM
Wouldn't ya know it? Not a single person was in kerra isle.

thanks for giving away my home away from home on red ass!

xious
01-20-2013, 09:02 PM
"Forceful Entry" 10

zerg guild

Forceful Entry is up to 15 now in my latest snapshot. Doesn't get any more zerg than this.

Resheph
01-21-2013, 08:29 AM
tbh, I'm just thinking shut the fuck up

Dude, what's your issue? This is not the RnF forum, it's Server Chat. Stop harassing people and crawl back in whatever hole you came out of.

Lagaidh
01-21-2013, 08:49 AM
These data snapshots make me very proud to be a dwarven paladin.... as if I needed another reason...

/grin

xious
01-22-2013, 12:53 AM
Another day, more data for my experiment ! This time with a database of 2154 characters, started picking up anonymous characters too - let's see if we can draw conclusion from these as time goes on.


druid 239
necromancer 219
shaman 196
monk 196
enchanter 175
cleric 167
warrior 160
bard 122
rogue 120
magician 117
shadowknight 112
wizard 92
paladin 81
ranger 80
ANONYMOUS 78



1 76
2 45
3 51
4 55
5 66
6 50
7 53
8 65
9 49
10 48
11 48
12 38
13 41
14 37
15 45
16 39
17 36
18 32
19 27
20 38
21 38
22 34
23 22
24 28
25 27
26 26
27 28
28 22
29 21
30 48
31 22
32 11
33 16
34 27
35 41
36 13
37 22
38 18
39 18
40 39
41 16
42 16
43 12
44 12
45 27
46 13
47 16
48 10
49 12
50 25
51 44
52 49
53 37
54 37
55 38
56 34
57 31
58 33
59 31
60 123
ANONYMOUS 78



Human 257
"Dark Elf" 243
Iksar 243
"Wood Elf" 227
"High Elf" 169
Halfling 154
Gnome 134
"Half Elf" 127
Barbarian 124
Dwarf 116
Erudite 103
Ogre 103
ANONYMOUS 78
Troll 76



"Bregan D`Aerth" 88
"Full Circle" 74
"The Mystical Order" 65
UNKNOWN 53
Asgard 46
"Peace Pipe" 42
Europa 39
"Knights Who Say Ni" 39
"Azure Guard" 39
Taken 36
Divinity 34
Arcadia 28
"Flawless Victory" 28
"Swampwater Taffy" 24
"Forceful Entry" 24
"The A-Team" 20
Sunnyvale 15
Kusemites 15
Shipwrecked 15
"Role Playing Guild" 9
"Honor Face" 9
"The Dark Exile" 8
"Amicus Ignis" 8
"Of Tholuxe Paells" 7
Ascendancy 7
Prophecy 7
"Free Raiders" 7
"Sacred Fyre" 7
"Mari Kita" 6
"Carpe Noctem" 6
LifeAlert 6
Ardness 5
"Prophetic Descent" 5
"Freedom Guard" 5
"The Night's Watch" 5
"Prestige Worldwide" 4
"Sacred Grove" 4
"The Warlords" 4
"The Pride" 4
"Eternal Rancor" 3
"LFG Puma Group" 3
Evoluxa 3
"The Dream Team" 3
"Order of the White Rose" 3
"Go Team Good Guys" 2
"Scars of Insanity" 2
Nightmare 2
"Lost Sock Patrol" 2
"The Alliance" 2
"Afkite Masters" 2
Chaos 2
Lads 2
Poison 2
"Utopia Project" 2
"Seriously Comical" 2
"Signum Lumen" 1
Maelstrom 1
Intolerant 1
Darkwind 1
"One Man Wolfpack" 1
Reclamation 1
"The Wretched" 1
Triality 1
"Loading Please Wait" 1
"Necro Death Squad" 1
"Immortal Companions" 1
"Bashin Ordur" 1
"Bloodline of Eld" 1
"Inglourious Basterds" 1
"Fashionably Late" 1
"Dark Twilight" 1
"Katximba Oscura" 1
Mischief 1
"Vesica Dei" 1
"Secret Of Mana" 1
Wudan 1
"Dark Ascension" 1
"Norrath's Curse" 1
Enraptured 1
Acyrid 1
"Kithicor Kids" 1
"Together As One" 1
"Dream Tribe" 1



ecommons 321
karnor 125
gfaydark 104
ANONYMOUS 78
oasis 67
unrest 61
mistmoore 59
overthere 58
fieldofbone 57
crushbone 56
sebilis 52
"Loading" 42
southkarana 41
nro 38
nektulos 38
commons 37
butcher 32
lakeofillomen 31
gukbottom 30
frontiermtns 30
citymist 29
blackburrow 29
steamfont 29
highkeep 26
lfaydark 25
airplane 25
kurn 24
dreadlands 24
everfrost 23
qeytoqrg 22
warslikswood 22
oot 22
misty 21
freportw 21
timorous 20
befallen 20
charasis 19
soldungb 19
guktop 18
qeynos2 17
freportn 14
rathemtn 14
soldunga 14
northkarana 13
paw 12
eastkarana 12
lavastorm 11
qey2hh1 11
kaesora 11
firiona 11
innothule 10
freporte 9
neriakb 9
akanon 9
cabeast 9
feerrott 9
neriaka 9
felwithea 8
trakanon 8
tox 7
swampofnohope 7
sro 6
highpass 6
hole 6
kaladima 6
skyfire 6
qcat 5
neriakc 5
droga 5
kaladimb 5
burningwood 4
kithicor 4
cabwest 4
lakerathe 4
permafrost 4
rivervale 4
oggok 4
najena 4
veeshan 4
cauldron 4
paineel 4
fearplane 3
qrg 3
kedge 3
erudsxing 3
emeraldjungle 3
erudnext 3
grobb 2
erudnint 2
qeynos 2
cazicthule 2
hateplane 2
soltemple 1
halas 1
beholder 1

xious
01-22-2013, 01:24 AM
hey bro, mind logging on red every now and then and get the numbers for that server too? nb4 someone says 20 person server lol

Just ran it on red for the first time, anon or roleplay seems too common to be able to pull any relevant data.. From 121 players online, I was only able to identify 14 players.

Not worth the time, sorry :P

SamwiseRed
01-22-2013, 01:36 AM
Just ran it on red for the first time, anon or roleplay seems too common to be able to pull any relevant data.. From 121 players online, I was only able to identify 14 players.

Not worth the time, sorry :P

ah figured the /who all count command could be used to get the data. all good bro

xious
01-22-2013, 11:21 AM
ah figured the /who all count command could be used to get the data. all good bro

Not implemented yet ! I'll think about the red server when it is, then.

Tecmos Deception
01-22-2013, 11:35 AM
Very interesting to me that only 5-6% of that 2100-character database are level 60.

falkun
01-22-2013, 01:10 PM
Very interesting to me that only 5-6% of that 2100-character database are level 60.

Its hard for parsers like this to account for L60 players that are currently on alts/EC-mules. What is telling about it is the large difference between counts of L60 and L51-54 and L55-59.
Levels
51 44
52 49
53 37
54 37
55 38
56 34
57 31
58 33
59 31
60 123
There are 167 L51-54 (4 level range), another 167 L55-59 (5 level range), and 123 L60s (1 level). Many more players finish the journey to 60 here on P99 than on Live. I attribute most of that to the longer release period that exists on P99 and secondly to the increased game knowledge of 13 years of experience.

stormlord
01-22-2013, 01:33 PM
I'd be interested in knowing how many of the low level players are new players or are they alts? If alts then it suggests that classic EQ also had a high alt population. They're called altaholics.

In fact, I recall that just before GOD Smed claims the average level was about 40. This was a talk about how bad of a failure GOD was. GOD's max level was increased by 5 too far. It was a disaster.

When I was playing this I was an altaholic. Highest level was 24. Was fun. Still get the itch sometimes. It's fun to see how the different classes play and to group with potential new players.

I also like the low level game more. Corpse runs aren't as bad. Lots of moving around in the city. Lots of interaction with new players. Death experience isn't heavy. Trade skills easy to get going. Basically, it doesn't require a lot of devotion to the game. You can come and go and there's no guild to complain about it.

Meh, I still got that itch for p1999. So many games fall short of what p1999 offers me. I wish other games would adopt more progression-type servers like EQ1-live has. I'd be more interested in them. The problem is they're so mudflated and empty that you can't enjoy the old content as much as you'd like to. Progression-type servers or features solve this because it removes a lot of hte mudflation and concentrates the players. You see from this that I prefer old content but it's hard to enjoy it in new games for these reasons and others. Now, if I was a veteran and had already seen the old content, I would want new content and be at home. But since I have a habit of playing old games I never got a chance to play, it's hard to reach satisfaction.

Live on p1999. You're a beauty.

xious
01-24-2013, 05:07 PM
Hey there, just wanted to say that I talked with Rogean about making the database public and while character names are left out, the data is otherwise now available here: http://p1999pop.dmsimard.com/

The next feature I'm probably going to implement is being able to click elements, like for instance:
- If you click on a class (bard), you will be able to see information about what levels they are, the guilds and zones they are in.
- If you click on a zone (karnor), you will be able to see information about what classes, levels and guilds are in the zone
- (etc)

Let me know if you have any ideas or suggestions :)

falkun
01-24-2013, 05:12 PM
Is this compiled by you (using the client) or did someone (Rogean?) parse the actual server? What were the parameters of the server data parse?

xious
01-24-2013, 05:36 PM
Is this compiled by you (using the client) or did someone (Rogean?) parse the actual server? What were the parameters of the server data parse?

This is done client side - Rogean has access to far superior tools to see what's going on on the server but he obviously cannot open these to the public :)

How it works essentially is that I've made a series of macros, for instance:
/who all cleric 1 10
/who all cleric 11 20
(etc)

The output of these are logged to the eqlog.txt file and then parsed and inserted/sorted into a database.
If the parser sees a newer record for a player, it updates the record in the database, it otherwise ignores it.

This allows me to eventually, as I run these macros several times a week, to catch every character at least once and end up having pretty accurate data.

Vykenos
01-24-2013, 05:43 PM
This data set will also become incorrect and bloated with old data as well wont it? Such as people leaving and not logging on there characters, characters no longer being used or deleted, etc.

It might be good to start a new tally ever month or so? Or maybe dating and purging entries that are not seen again over a certain time so the information is kept fresh to represent the server?

xious
01-24-2013, 05:47 PM
Sure, I guess I could have records expire after a period of time that I haven't "seen" them.

Should be fairly easy to do, too. I'll implement that, great idea :)

Lyra
01-24-2013, 05:49 PM
he obviously cannot open these to the public

Not obvious to me - Although it's his server to do as he pleases.

character names are left out

This information is available, including character name, to anyone playing the game. You have been so kind as to gather data in one place. Not sure why the name should be considered private information. - But again...your thing.

xious
01-24-2013, 05:52 PM
Are character names relevant though ? I don't want to create a tool so people can brag/rant/flame/troll, etc.

Thana8088
01-24-2013, 06:11 PM
When I try to look at a population, I get this:

Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.

Please contact the server administrator, root@localhost and inform them of the time the error occurred, and anything you might have done that may have caused the error.

More information about this error may be available in the server error log.


--------------------------------------------------------------------------------

Could it be something on my side? Our IT people don't let us do anything!

xious
01-24-2013, 06:47 PM
Nope, that was indeed a problem - fixed now though.

August
01-24-2013, 06:59 PM
How do you prevent contamination of data?

Say you do a parse and I am playing as a level 10 cleric and then the next day I am level 11. I am now in 2 buckets and my character is counted twice.

Lyra
01-24-2013, 06:59 PM
Are character names relevant though ? I don't want to create a tool so people can brag/rant/flame/troll, etc.

The relevance is subjective. - And it is your tool.

What are you using the data to determine and for what purpose?

Thana8088
01-24-2013, 07:02 PM
Nope, that was indeed a problem - fixed now though.

Ah, much better. Thank you!

Forgive my ignorant question because I'm not really a numbers person, but is this cumulative data and not necessarily who's logged in at any one time?

xious
01-24-2013, 08:21 PM
What are you using the data to determine and for what purpose?

Purpose is two fold: I wanted to see if I could get real numbers to answer the oft-asked question "What classes are needed on the server ?" and this is also a learning experience - I'm well versed in many programming languages but this is my second real Python project.

I figured if I would make a tool for myself that others may benefit from it so there's the website.

Forgive my ignorant question because I'm not really a numbers person, but is this cumulative data and not necessarily who's logged in at any one time?

All the data is cumulative but is ultimately tied to each and every character that my parser "see". As in, if I see the same bard twice, I'm not going to count two bards but update that bard's data.
I'm hoping that if I take snapshots of online characters at various weekdays and hours that I'll eventually have something that is very relevant and close to reality.
This also does not account characters that are /anonymous and /roleplay.

TheSK
01-25-2013, 08:55 PM
EDIT
Data is now available directly on http://p1999pop.dmsimard.com

I was curious to see what kind of population statistics I could pull from the client side, so I went away and made a server population parser script.
Obviously, this could have been done far easier from the server side but I don't happen to have that sort of access :P

At the time I've ran my "snapshot" for data, there were 699 players online and my parser was able to find and identify 440 characters. (Friday January 18th at 4:45PM EST)
This means that 259 characters were either /Anonymous or on /Roleplay.

Please excuse me, I'm bad with graphs and charts, but here's some data.
If someone wants to use the raw parsed data to make some awesome charts, let me know and I'll give it to you :)

Wow. You need a real life, and quick.

August
01-25-2013, 09:08 PM
Wow. You need a real life, and quick.


I think a lot of people would say the same about you.

TheSK
01-25-2013, 11:54 PM
I think a lot of people would say the same about you.

Why are you here August? You are several month early, please go away. Thanks :D

xious
01-26-2013, 10:59 AM
Why the needless bashing ? Go to the rants and flames section.

Thanks.

nilbog
01-26-2013, 11:04 AM
Wow. You need a real life, and quick.

Server chat is not the place for this. Obey the forum rules or you will be removed.

Tecmos Deception
01-27-2013, 09:34 PM
Love this database :)

Can we get % breakdowns on there too? I'd ask about getting interactive data too, so that I could, like, see what level ranges kill off different classes and see if people who play certain races are more likely to make it to 60 and all kinds of whatnot... but that'd just be greedy!


Man. I still just can't get over how only 5% of characters are 60, and only 20% are 51+.

xious
01-28-2013, 01:28 PM
Love this database :)


Thanks ! :)


Can we get % breakdowns on there too?


Great idea, done !


I'd ask about getting interactive data too, so that I could, like, see what level ranges kill off different classes and see if people who play certain races are more likely to make it to 60 and all kinds of whatnot...


Yup, I already planned something like this - being able to click a class and see their levels, guilds, zones - being able to click a zone and see the classes, levels, guilds - etc.

Maybe sometime this week if I have time !

falkun
01-28-2013, 01:45 PM
If you properly utilized the /who all count command, you could generate data that ignores anonymous. I do not know how many factors you can combine (zone, class, guild, level, race), but the count function does ignore anonymous and simply returns a number instead of all matches.

sanluen
01-28-2013, 01:48 PM
First of all, this is really neat! Thanks for taking the time to make this!



Man. I still just can't get over how only 5% of characters are 60, and only 20% are 51+.

I think this is going to be skewed no matter what. Level 60 raid characters are almost always /roleplay and are very often logged out buffed at some raid target. People then log in their alts and go grind XP (generally without anon or roleplay). Perhaps when the full /who all x count feature is done, that will help!

I also think that the bard count is inflated due to EC mules. I know everyone makes a bard twink at some point and gives up once they realize they aren't good enough to AE kite, or once they hit 45 and OT slows down, but I feel like many of them are just holding piles of platinum.

xious
01-28-2013, 01:50 PM
If you properly utilized the /who all count command, you could generate data that ignores anonymous. I do not know how many factors you can combine (zone, class, guild, level, race), but the count function does ignore anonymous and simply returns a number instead of all matches.

Yup, I'll eventually integrate that - it's simply a bit tricky because of the output it generates.

Like, if you do "/who all iksar count" it returns something like:
"There are 162 players in EverQuest".

I wish it would return something like this instead:
"There are 162 Iksar players in EverQuest"

I'm happy with the data I have right now and it'll get better with time too.
Real counts will come a bit later down the road.

falkun
01-28-2013, 02:45 PM
You could alter the macros for your search so you have something to parse with Python:

/say Now searching for iksar players
/who all count iksar

Will generate output:
You say, 'Now searching for iksar players'
There are 162 players in Everquest.

Then you can parse on your /say statement and have python remove the appropriate string (162) of the next "There are XXXX players in Everquest" that appears

Could also make your /say statement more unique so its easy to parse for that statement.

xious
01-28-2013, 04:02 PM
Yup, that's exactly what I had in mind !

Duckforceone
01-28-2013, 04:08 PM
we used to parse with a special created channel, where the parser only took stuff said in that channel, and the zone listing when we typed that..

falkun
01-28-2013, 04:15 PM
Except channels don't work on P99.

xious
01-28-2013, 05:56 PM
Except channels don't work on P99.

Yeah, I don't want to stray away from the topic too far but why is that exactly ? Is it a client limitation ? I know Shards of Dalaya got theirs working only recently.

falkun
01-29-2013, 10:08 AM
Its a server restriction because channels aren't classic. Titanium client definitely supports chat channels, but they aren't classic. Honestly, it doesn't matter a whole lot because everyone pretty much uses voice chat for raids anyways, but it does keep the selling in EC instead of server-wide (doesn't R99 utilize the global /ooc for most trade endeavors?)

xious
01-30-2013, 11:38 PM
Okay, this was harder than I thought it would be but I just completed the feature I wanted the most.

You can now click on different elements to get more information about them.
For instance, if you click on a class, you'll see their races, levels, guilds and zones.

Examples:
- http://p1999pop.dmsimard.com/details/Classes/druid
- http://p1999pop.dmsimard.com/details/Guilds/The%20Mystical%20Order
- http://p1999pop.dmsimard.com/details/Zones/ecommons

Next feature i'll implement is character record expiration as suggested by Vykenos (http://www.project1999.org/forums/showpost.php?p=825001&postcount=44).

If the parser hasn't seen a character for more than a month, it will stay in the database but will be tagged as expired and won't be accounted on the website's statistics.
I haven't thought relevant to implement this quickly as I don't even have data three weeks old yet.

Enjoy !

Karafa
01-30-2013, 11:50 PM
Wow. You need a real life, and quick.

this nerd is averaging multiple posts per day since his 2013 join date, pot calling kettle black much?

xious
02-03-2013, 01:46 PM
Just wanted to say that the database has now more than 4200 characters in it and I keep picking up characters I hadn't seen before !

What features would you guys like to see? Aside from graphs, I hate graphs.

Edit: Oh nevermind 4200 characters, 4398 now >_<

odiecat99
02-03-2013, 01:49 PM
add <THE DREAM TEAM> to guilds

xious
02-03-2013, 01:57 PM
add <THE DREAM TEAM> to guilds

The dream team seems there :)
http://p1999pop.dmsimard.com/details/Guilds/The%20Dream%20Team

odiecat99
02-03-2013, 02:00 PM
oh, thank you sir.

enr4ged
02-03-2013, 02:14 PM
I'd like to see a way to list characters and their stats. Unless this is available and I missed it, let me know!

odiecat99
02-03-2013, 02:15 PM
I'd like to see a way to list characters and their stats. Unless this is available and I missed it, let me know!

that would be quite epic.

xious
02-03-2013, 02:38 PM
Ah, I can't do something from within the client. A true "magelo" would be awesome but I can't do this without being able to access the real database that the server is running !

xious
06-17-2013, 09:57 AM
Hey there,

I saw that the website is referred to often and I feel bad that the data hasn't been kept up to date :D

Many samples will be necessary over the next few days to make sure it's as accurate as possible, I'll take the necessary time to do so.

Enjoy :)

HeallunRumblebelly
06-17-2013, 09:58 AM
Nice, would be good to see a comparison versus peak time.

Also don't forget a "/who all count" can list with anons included, for example "/who all iksar count"

But what about people like chest, the uncountables?!

Cecily
06-17-2013, 10:41 AM
Someone explain that to me? Why the hell can you not /who all chest?

Krazed
06-24-2013, 08:52 AM
http://i.qkme.me/3qc135.jpg

xious
06-24-2013, 10:08 AM
Ahah, yup.

Actually working on this now. OP will deliver :D

Tecmos Deception
06-24-2013, 10:12 AM
Hey there,

I saw that the website is referred to often and I feel bad that the data hasn't been kept up to date :D

Many samples will be necessary over the next few days to make sure it's as accurate as possible, I'll take the necessary time to do so.

Enjoy :)

:D:D:D:D:D:D:D

xious
06-24-2013, 11:50 AM
Hey so I got everything set up again. Ran an update just now.

I found 220 new characters and updated 209 of which I had already seen.

I'll try to run this three times a day for a few days, morning, afternoon and evening. I'll wait a week or so before expiring older records so that data is kept relevant and is not skewed simply by a smaller amount of characters.

Enjoy !

Lyra
06-24-2013, 11:57 AM
Beginner's Luck 18 (0.39%)

Have they made a comeback I don't know about?

xious
06-24-2013, 12:13 PM
Have they made a comeback I don't know about?

Nah, I checked and all the records I have for that guild dates from back in February.
Characters that have not been seen in the next week or so will be expired so records like these will not be a problem anymore.

Phats
06-24-2013, 03:45 PM
Doing a full week of scans in the early morning, afternoon, and evening will compliment all time zones. To find concurrent UNIQUE users, you should set the expired data for 2 weeks, 1 isn't enough time. IMO.

xious
06-24-2013, 03:56 PM
Doing a full week of scans in the early morning, afternoon, and evening will compliment all time zones. To find concurrent UNIQUE users, you should set the expired data for 2 weeks, 1 isn't enough time. IMO.

What do you mean ? If I see the same character twice, I update the record, it isn't accounted as two characters - is that what you mean for unique users ?
If I haven't "seen" a character for a month, it would usually expired and be removed from the statistics - but since I haven't updated the database since february, I didn't want to remove everything.. just yet.

xious
06-24-2013, 06:46 PM
Things are going well, made 4 updates today and found more than 800 new characters. Up to 5095 now :)

http://p1999pop.dmsimard.com/db/Classes

stormlord
06-24-2013, 07:45 PM
Xious, what you think about these comments:
http://www.project1999.org/forums/showpost.php?p=768007&postcount=48

There's a chart linked there. Here:
http://i52.tinypic.com/2dlll6e.jpg

It's an older chart from (i think) june 2011 that shows project 1999 population stats.

One thing to say is that the linked chart doesn't show the actual population at each level range; it only shows the population share. So it's going to be less accurate than your live readings.

My goal with the chart wasn't just to see the absolute population of each class, but also to see how well each class translates from the lower levels to the higher levels. Surprisingly, classes like the druid and necromancer, according to the chart, have less popularity at max level than at lower levels. The group-based classes, by comparison, actually do much better at max level than at lower levels, even versus the Shaman. What this shows is that classes which focused on something - rather than being diverse - were favored more. And this is even true for the Wizard, even though it has a low popularity in absolute population share. The Wizard translates slightly better to max level than a Shaman, even though the Shaman is more popular.

I was looking at your live readings for the classes, here:
http://p1999pop.dmsimard.com/db/Classes

I compared the average population percentages on the chart to your live readings and got:
(the chart)
druid: 11.1428
necromancer: 11.1428
monk: 9.1428
magician: 9
cleric: 8.8571
shaman: 8.2857
enchanter: 8.1428
warrior: 7.4285
bard: 5.5714
rogue: 5.5714
shadowknight: 4.8571
wizard: 4.7142
paladin: 3.2857
ranger: 2.8571

/ = equal
! = +/- 1
# = +/- 2
<--- = difference is greater than 2

druid /
necromancer /
monk /
shaman #
warrior <---
enchanter !
cleric #
bard !
rogue !
magician <---
shadowknight /
wizard /
ranger !
paladin !
So the major difference is that the warrior population went up with your stats and the magician population went down. I wonder if this says something about changes to those classes?

And btw... for those wanting to pick a class with longevity and is popular overall...

Here're the classes that translate best to max level (from june 2011), ordered by their absolute popularity:
1. Monk
2. Shaman
3. Warrior
4. Enchanter
5. Cleric
6. Rogue
7. Wizard

My opinion:
There's not any doubt that the monk is an all-star class. It has high longevity and high popularity. It's a tie between Cleric and Warrior. Enchanter has to be included because of its longevity. I'm less supportive of the Shaman because its longevity is lowest of all of them, but it's still better than a Necro or Druid.

Take note: A real comparison between classes needs to weight longevity and overall popularity. So if the longevity is lower, a high popularity can compensate and still give a class a decent rating.

xious
06-24-2013, 09:48 PM
Interesting chart, may I ask where you got the numbers from ?

My database is a bit out of date - I'm still dragging records from January/February that may or may not be relevant anymore. This is why I'm refreshing it this week.
Thing is, however, active or inactive, I have picked up 5095 unique characters. That's a lot :D

xious
06-26-2013, 08:47 PM
Out of the 6000 characters now in the database, there are only 557 characters I haven't seen since monday (whose' records date back to february) - that's kind of interesting actually. It means that most players are still here !

Lyra
06-26-2013, 08:57 PM
A Collection of Fine Gentlemen 1

Accurate data is accurate

xious
06-26-2013, 09:18 PM
Accurate data is accurate

Ahah, oh yeah. And you can almost tell who it is by looking up the guild info too: http://p1999pop.dmsimard.com/details/Guilds/A%20Collection%20of%20Fine%20Gentlemen

Ambrotos
06-26-2013, 11:07 PM
When I get a chance I'll post the stats of people online tonight. I saw 900 people online. Maybe sometime tmro.

xious
06-29-2013, 12:16 PM
Oh, man, I screwed up. I thought there was around 500 characters that had not been seen since since february but my SQL fu failed me.
There are, in fact, 4034 characters that I have not seen this week so far (updating sometimes more than 3 times a day) and whose data dates back to January/February.

What do you guys think I should do with these ? This changes my plan .. I think they're still relevant to some extent since they are characters that EXIST on the server.

Gadwen
06-29-2013, 01:22 PM
Oh, man, I screwed up. I thought there was around 500 characters that had not been seen since since february but my SQL fu failed me.
There are, in fact, 4034 characters that I have not seen this week so far (updating sometimes more than 3 times a day) and whose data dates back to January/February.

What do you guys think I should do with these ? This changes my plan .. I think they're still relevant to some extent since they are characters that EXIST on the server.

use it

webrunner5
06-30-2013, 08:58 AM
I compared the average population percentages on the chart to your live readings and got:
(the chart)
druid: 11.1428
necromancer: 11.1428
monk: 9.1428
magician: 9
cleric: 8.8571
shaman: 8.2857
enchanter: 8.1428
warrior: 7.4285
bard: 5.5714
rogue: 5.5714
shadowknight: 4.8571
wizard: 4.7142
paladin: 3.2857
ranger: 2.8571

/ = equal
! = +/- 1
# = +/- 2
<--- = difference is greater than 2

druid /
necromancer /
monk /
shaman #
warrior <---
enchanter !
cleric #
bard !
rogue !
magician <---
shadowknight /
wizard /
ranger !
paladin !
So the major difference is that the warrior population went up with your stats and the magician population went down. I wonder if this says something about changes to those classes?

And btw... for those wanting to pick a class with longevity and is popular overall...

Here're the classes that translate best to max level (from june 2011), ordered by their absolute popularity:
1. Monk
2. Shaman
3. Warrior
4. Enchanter
5. Cleric
6. Rogue
7. Wizard




Hard for me to believe a Wizard is even on the list. But very glad for your effort on this. :D

Danth
06-30-2013, 09:26 AM
What do you guys think I should do with these ? This changes my plan .. I think they're still relevant to some extent since they are characters that EXIST on the server.

If you can't decide what to do, you could always add a new tab to your chart. Label one tab "active characters" and another tab "all characters." Include the inactive characters in the latter tab.

-----------------------------

It makes sense that classes like Wizards, Clerics, and Warriors would do well at level 60 (they're important raiding classes) while solo-oriented classes would peter out somewhat. Druids, in particular, are often created for the purpose of serving as port mules and hence don't need to get to high levels to perform that role well. The hybrid classes tend to run out of gas in the mid 50's as the experience penalty crushes their will to level.

Danth

xious
06-30-2013, 10:03 AM
If you can't decide what to do, you could always add a new tab to your chart. Label one tab "active characters" and another tab "all characters." Include the inactive characters in the latter tab.

-----------------------------

It makes sense that classes like Wizards, Clerics, and Warriors would do well at level 60 (they're important raiding classes) while solo-oriented classes would peter out somewhat. Druids, in particular, are often created for the purpose of serving as port mules and hence don't need to get to high levels to perform that role well. The hybrid classes tend to run out of gas in the mid 50's as the experience penalty crushes their will to level.

Danth

Hey, that's not a crazy idea. I'll check how I can implement this in a smart way considering I might not be updating the database every day until the end of time.

Gamkek
07-19-2013, 06:14 PM
Are character names relevant though ? I don't want to create a tool so people can brag/rant/flame/troll, etc.

You're absolutely right. The names of the characters has no bearing on anything and can only be used for evil and drama-generating threads. It also compromises the anonymity of players who don't want to be bothered with requests for ports/rezzes, etc. while they're in-game.

myxomatosii
11-15-2013, 11:48 AM
Bump

xious
11-15-2013, 11:49 AM
What's the bump about ? :)

Joseppi
11-15-2013, 11:51 AM
very cool

myxomatosii
11-15-2013, 11:59 AM
What's the bump about ? :)

this is a cool tool that a lot of people don't know about, with a constantly growing pop i thought it should be brought to attention again. after all the last post was back in july

xious
11-15-2013, 12:02 PM
this is a cool tool that a lot of people don't know about, with a constantly growing pop i thought it should be brought to attention again. after all the last post was back in july

Okay, I might as well do another round of updates then. Give me a week or so to get some data.

xious
11-15-2013, 12:35 PM
Made a first quick update, lots of new characters :)

Nov 15 11:34:37 - EqPopParserModel - INFO - Database synchronization completed.
Nov 15 11:34:37 - EqPopParserModel - INFO - * Inserted 310 new records.
Nov 15 11:34:37 - EqPopParserModel - INFO - * Updated 762 records
Nov 15 11:34:37 - EqPopParserModel - INFO - * Ignored 0 outdated records.

Gadwen
11-15-2013, 07:00 PM
+1, great work being done here

xious
11-15-2013, 08:28 PM
I just noticed that I did not put %'s for the detailed reports, I added them.

47% of druids are wood elves! http://p1999pop.dmsimard.com/details/Classes/druid
15% of all level 60's are enchanters ! http://p1999pop.dmsimard.com/details/Levels/60
etc. etc.

Dulu
11-16-2013, 02:55 PM
Interesting that Erudites have the best stats for 1/3rd of the classes in the game, yet have the lowest population..

Are EQ players racist?

Tikku82
11-16-2013, 03:10 PM
Interesting that Erudites have the best stats for 1/3rd of the classes in the game, yet have the lowest population..

Are EQ players racist?

Erudites are ugly and start from middle of nowhere

myriverse
11-16-2013, 03:37 PM
Erudite females are the hottest.

Dulu
11-16-2013, 03:51 PM
Erudites are ugly and start from middle of nowhere

Middle of no-where, yet they have docks that go to almost anywhere.

xious
11-18-2013, 08:12 PM
Just dropping by to say that the database has more than 10 000 unique characters now, 10 061 to be exact :)

Barahir
11-22-2013, 02:54 PM
How exactly is this data compiled and how accurate are the guild numbers?

xious
11-22-2013, 04:39 PM
How exactly is this data compiled and how accurate are the guild numbers?

The data is retrieved client side through what essentially consists of a bunch of social macros which do "/who all cleric 1 10, /pause 10, /who all cleric 11 20" (etc).
The output is logged, parsed and matched against the database.

If the character is not in the database, it is inserted.
If the character is in the database, it is updated.

I log at various times (morning, afternoon, evening, night) to try and catch all timezones.

So, right now, the database has 10399 unique characters. The "oldest" characters I have in the database date back as far as 2013-01-19 16:40:03. This means I haven't "seen" them since then.

Hope this answers your question :)

eqravenprince
11-22-2013, 05:25 PM
T
The "oldest" characters I have in the database date back as far as 2013-01-19 16:40:03. This means I haven't "seen" them since then.


That might be me!!! What's the characters name?

xious
11-22-2013, 06:19 PM
That might be me!!! What's the characters name?

There's a few thousand characters that my parser hasn't seen in a few months :)

baalzy
11-22-2013, 07:42 PM
Interesting that Erudites have the best stats for 1/3rd of the classes in the game, yet have the lowest population..

Are EQ players racist?

Cleric: Not the worst but def not 'best'. Similar stats to several other races but no racial abilities/bonus' to make them stand out like hide/sneak/xp bonus from a halfling or just hide from dark elf. From a pure stat standpoint dwarf is hard to ignore with that huge str/stam advantage.

Enchanter: A very viable choice, however, High Elf edges them out for best since +cha is harder to acquire than +int. Human is up there too but doesn't have a super clear advantage, probably a tie.

Magician: No truly clear winner, but I'd concede erudite if you pressed it. The margins are extremely slim.

Necromancer: Iksar master race. Beyond that bertoxx following gnomes are actually very well tolerated compared to CT & Inny followers (dubious/apprehensive in a lot of places where other necros would be KoS). From a lvl 60 not caring about faction standpoint the Erudite probably takes second because of erudite specific itemization.

Shadowknight: Ogre, Troll are very clear winners. Human and Iksar runners up, though that dex/agil on the iksar i'm sure helps. Erudite and Dark Elf can squabble over last place although I'd probably give it to the erudites because of how far behind their agility/dex is to the DE.

Paladin: Dwarf and Human clearly have the edge. The high elf and erudite can have a sissy fight over who is weaker though.

Wizard: See mage.

Barahir
11-23-2013, 02:56 AM
The data is retrieved client side through what essentially consists of a bunch of social macros which do "/who all cleric 1 10, /pause 10, /who all cleric 11 20" (etc).
The output is logged, parsed and matched against the database.

If the character is not in the database, it is inserted.
If the character is in the database, it is updated.

I log at various times (morning, afternoon, evening, night) to try and catch all timezones.

So, right now, the database has 10399 unique characters. The "oldest" characters I have in the database date back as far as 2013-01-19 16:40:03. This means I haven't "seen" them since then.

Hope this answers your question :)

So no tracking of /anon or /role then?

Waedawen
11-23-2013, 10:55 PM
If I'm not mistaken even if you're /anon or /role you'll still be detected by specific class searches

Barahir
11-23-2013, 11:53 PM
If I'm not mistaken even if you're /anon or /role you'll still be detected by specific class searches

I do not think so.

I know for sure that /w all cleric 1 10 would not yield any anon/role in that level range. Maybe /w all cleric would yield up to 20 clerics but I don't think any anon/role would be included.

Tanthallas
11-23-2013, 11:56 PM
One Man Wolfpack 1

lol

Tann
11-24-2013, 12:08 AM
anon/role aside, kinda crazy that there are more enchanters @ level 60 then all the hybrids combined, 4x fewer druids, and the other pure casters barely pull ahead combined.

Clark
11-24-2013, 01:56 AM
Erudites are ugly and start from middle of nowhere


Erudite females are the hottest.

Gecko
11-24-2013, 12:17 PM
The data is retrieved client side through what essentially consists of a bunch of social macros which do "/who all cleric 1 10, /pause 10, /who all cleric 11 20" (etc).
The output is logged, parsed and matched against the database.


If I'm not mistaken /who call count actually ignores role and anon for class statistics. You might want to change your script to use that.

huron99
11-24-2013, 12:45 PM
/who all cleric count or /who all 1 10 cleric count will include anon/role afaik. Just not specific names.

Dulu
11-24-2013, 07:15 PM
Cleric: Not the worst but def not 'best'. Similar stats to several other races but no racial abilities/bonus' to make them stand out like hide/sneak/xp bonus from a halfling or just hide from dark elf. From a pure stat standpoint dwarf is hard to ignore with that huge str/stam advantage.

Enchanter: A very viable choice, however, High Elf edges them out for best since +cha is harder to acquire than +int. Human is up there too but doesn't have a super clear advantage, probably a tie.

Magician: No truly clear winner, but I'd concede erudite if you pressed it. The margins are extremely slim.

Necromancer: Iksar master race. Beyond that bertoxx following gnomes are actually very well tolerated compared to CT & Inny followers (dubious/apprehensive in a lot of places where other necros would be KoS). From a lvl 60 not caring about faction standpoint the Erudite probably takes second because of erudite specific itemization.

Shadowknight: Ogre, Troll are very clear winners. Human and Iksar runners up, though that dex/agil on the iksar i'm sure helps. Erudite and Dark Elf can squabble over last place although I'd probably give it to the erudites because of how far behind their agility/dex is to the DE.

Paladin: Dwarf and Human clearly have the edge. The high elf and erudite can have a sissy fight over who is weaker though.

Wizard: See mage.


I was trying to say Erudites have the highest Int, so would make the best casters.

Clearly I didn't think it out far enough to consider all of these other variables, particularly Cha for Enchanters and the regen of Iksar Necros.

I still think they're a fairly under-appreciated race, and have great starting stats, awesome looking armor (particularly on SK's/Paladins), and a really cool city/starting area.

xious
11-24-2013, 10:49 PM
So no tracking of /anon or /role then?

They come up. I have the character names.
For anon players, all I have is their name, for roleplaying I have their guild - if any:
http://p1999pop.dmsimard.com/details/Levels/ANONYMOUS

I've thought in the past about implementing "/who all <X> count" but it's really about the characters, not the numbers. I'd rather have the characters :)

xious
01-05-2014, 01:56 AM
No clue what is going on but I am picking up new characters like crazy recently.
Could it be the EQMac influx ?

At more than 12k characters now.

Valoril
01-05-2014, 10:26 AM
What would be interesting but then the database grows really huge and you need a script, would be a statistic about the "hours played".

Like :
Over the last month :
20 % players represent 0-10 hours played
35 % players represent 11 - 50 hours played
etc

This would give a good idea about the percentages of addicts (f.ex > 100 hours/month) vs casual but regular (f.ex 25-50 hours/month)

Rhambuk
01-05-2014, 10:37 AM
I don't think its possible because you cant /who this information but

would love to see a male/female character perspective, Ogre warriors not that rare, FEM ogre warriors on the other hand.

xious
01-05-2014, 05:35 PM
What would be interesting but then the database grows really huge and you need a script, would be a statistic about the "hours played".

Like :
Over the last month :
20 % players represent 0-10 hours played
35 % players represent 11 - 50 hours played
etc

This would give a good idea about the percentages of addicts (f.ex > 100 hours/month) vs casual but regular (f.ex 25-50 hours/month)

I don't think its possible because you cant /who this information but

would love to see a male/female character perspective, Ogre warriors not that rare, FEM ogre warriors on the other hand.

Unfortunately those are things I can't retrieve client-side ! Sorry !

baalzy
01-09-2014, 06:22 PM
Does your database store a 'last date seen'? It would be awesome if we could filter to only include toons which you've seen in the last 30-60-90 days or something.

Also, if you really really really wanted to get fancy(re:tedious) you could park alts in each zone that way you can log into them and /guildstatus all the anon players.

xious
01-09-2014, 06:27 PM
Does your database store a 'last date seen'? It would be awesome if we could filter to only include toons which you've seen in the last 30-60-90 days or something.

Also, if you really really really wanted to get fancy(re:tedious) you could park alts in each zone that way you can log into them and /guildstatus all the anon players.

Yeah, I store the date at which the character was last seen and I could do that but I don't want to do it until I am able to pull data on a regular basis. Otherwise there would be "holes" in the data.
Like, right now, I haven't pulled data since January 6th.
I have an idea on how to tackle that but I haven't had time to do it yet.

I introduced http://p1999pop.dmsimard.com/population yesterday and I have some other stuff I want to work on - maybe within the next few weeks.

The guildstatus thing would be too tedious, ugh :)

xious
01-09-2014, 06:40 PM
omg you rock that kicks my pop tracking project right in the face!!

Sorry ? :(

What I want to do for the time being:
- A timeframe tab (Maybe something like 24h, 7 days, 31 days, 1 year, all time..)
- A moving average as per calculated by the data I have, not EQEmu's average which doesn't seem to be calculated very often

xious
01-09-2014, 07:06 PM
I was manually tracking population in Excel, when i see your beautiful graph it makes me shed a single tear.

THANK YOU for the GREAT STATISTICS!!

can we get independent readout for Red and Blue on the same graph axis

Yeah, I can. I'll add it eventually.

xious
01-10-2014, 08:01 PM
I just finished adding PvP data. The graph looks a bit weird right now but give it a few days and it should become pretty cool.

xious
01-11-2014, 08:40 PM
I just did a small tweak to the application that parses the character information.
Kind of hard to explain but if it gets fed a character that is anonymous (or roleplay) AND it already has a record for that character, it won't update this character's information.

Before this change, one day I could have picked up a guilded 60 druid and if he went anonymous the next day, he would show as an unguilded anonymous in the database. Now he will remain as a 60 guilded druid and ignore the anonymous record.

I did this in hope of reducing the amount of anonymous characters there is in the database. Close to 10% of recorded characters are anonymous. Out of 15k characters, that's a lot !

Edit: For the record, there are 1396 anonymous characters in the database right now. Curious to see if I can get that number to drop in the next few days :)

innocent51
01-12-2014, 05:58 AM
Interesting that Erudites have the best stats for 1/3rd of the classes in the game, yet have the lowest population..

Are EQ players racist?
When I 1st started Everquest (for real, when Vazaelle came out) I asked my friend (IRL friend, I was working in a computer shop, we have a basement with 30 comps, good ol times) : "Hey guys whats the least played class/race combo" and one said "Maybe Gnome warrior?", than another argued "There are a lot of warriors tho". So I asked "But what is the worse class" and they all said "Shadowknight! They cant tank, cant deal damage, cant heal, cant port, cant buff", so I asked "what's the worse race for a Shadowknight" and they said "Probably Dark Elf but every single SK is Dark Elf". So I clicked around the character creation and asked "What about Erudite? Their stats looks terrible for a melee" and they looked at me puzzled "Can Erudite even be Shadowknight?".

Elindra was born. I spent the night harm touching rats and suiciding on guard to have HT up again. I Spent hours on her, raided for years, never looked back: Erudite are awesome!

Messie
01-12-2014, 12:01 PM
this is awesome. thank you for posting this!

tristantio
01-13-2014, 01:45 PM
When I 1st started Everquest (for real, when Vazaelle came out) I asked my friend (IRL friend, I was working in a computer shop, we have a basement with 30 comps, good ol times) : "Hey guys whats the least played class/race combo" and one said "Maybe Gnome warrior?", than another argued "There are a lot of warriors tho". So I asked "But what is the worse class" and they all said "Shadowknight! They cant tank, cant deal damage, cant heal, cant port, cant buff", so I asked "what's the worse race for a Shadowknight" and they said "Probably Dark Elf but every single SK is Dark Elf". So I clicked around the character creation and asked "What about Erudite? Their stats looks terrible for a melee" and they looked at me puzzled "Can Erudite even be Shadowknight?".

Elindra was born. I spent the night harm touching rats and suiciding on guard to have HT up again. I Spent hours on her, raided for years, never looked back: Erudite are awesome!

I too am working on an Erudite Shadow Knight - having a great time on her so far!

Btw the pop parser looks awesome, nice work!

xious
01-14-2014, 02:27 PM
Cool, we're able to pinpoint when there has been a downtime or a patch :)

http://p1999.dmsimard.com/population

xious
02-15-2014, 10:59 AM
Hey. It's me again.

I've added time ranges to the population graph - I've been mostly lazy in the implementation and I attribute that to my lack of free time recently. It does the job, however.

See for yourself: http://p1999.dmsimard.com/population

Enjoy.

Tubben
02-15-2014, 03:02 PM
/who count 10 all
/who count druid all

If you want to see all online per level / class