p99 wiki: new Auction Tracker (logs requested!)

[Ravhin]

Hey guys,

I've been working on an auction tracker within the p99 wiki. You can see pricing info on any item page, when it exists. For instance:

http://wiki.project1999.org/index.php/Stein_of_Moggok

http://wiki.project1999.org/auctiontracker/Jade_Chokidai_Prod.png

This works just like before - we need users to upload their log files to get pricing info! The page to contribute and for more info is here:

http://wiki.project1999.org/index.php/Special:AuctionTracker

Any logs are always welcome! This project is still very beta, so things may change, and I'm open to suggestions for improvement.

[Estu]

Just FYI, jetviper (stairs) told me he'd get the auction tracker back up at some point; he apparently got hit by the hurricane a couple weeks ago and has been dealing with that. Still, though, he didn't give any specific date so this is pretty great in the meantime (and could possibly be a good replacement, especially since it's linked to the rest of the wiki).

[Humerox]

Bravo, Ravhin!

[Baa]

Awesome!

[maximum]

A premier wiki addition!

[Azu]

That has got to be one of the coolest Wiki Features i have ever seen. great job! :D

[skulldudes]

ec has been borked without the auction tracker. well played my man

[AreYouAngered MyBrother]

Thank you very much

[Spud]

YAY!

[Kyrus]

Very cool...just to make sure I understand, you need people in EC to send in their logs of people auctioning different items, and then you take that data and add it to this feature on the wiki so everyone can see the going rate on items? If so, what's the process for uploading the log files? Is this data automatically stored somewhere in our EQ folder, or do we have to type something in game for it to start keeping track of the text?

[bizzum]

Very cool...just to make sure I understand, you need people in EC to send in their logs of people auctioning different items, and then you take that data and add it to this feature on the wiki so everyone can see the going rate on items? If so, what's the process for uploading the log files? Is this data automatically stored somewhere in our EQ folder, or do we have to type something in game for it to start keeping track of the text?

You have to type /log on a character to start tracking the logs, and then it becomes a text file eqlog.txt, which you upload to the site.

[Kyrus]

Ah ok, thanks. If/when I'm in EC I'll make one.

[Nimblerot]

Man, this is going to make it much harder for Armani to charge 33% above market value for items...


Great work =)

[falkun]

Today, I notice something while previewing the Ceremonial Iksar Chestplate (http://wiki.project1999.org/index.php/Ceremonial_Iksar_Chestplate) page. I do not think the log accurately interprets "K" for thousand. There are two entries, one on the 21st and another on the 26th for "30" while all of the other entries are for 28000-32000. These two entries for 30 dramatically reduce the average price as outliers. I am willing to bet that these are actually "30K" or "30k" and not being auctioned for "30". Is there any way for you to parse the metric abbreviation for 1000 appropriately?

Thanks for all the work you have done on bringing this feature to the wiki, as well as all of the other work you do for the wiki. It truly is an amazing resource.

[phobus]

I think the more likely explanation is that the log parser correctly interprets the K suffix, but in these cases, the seller left it out. People do that sometimes for expensive items where it's clear they're talking about 30k, not 30pp.

If the parser didn't correctly interpret the K suffix, I think we'd see way more errors like this. After all, when was the last time you saw an auction like "WTS Ceremonial Iksar Chestplate 28000pp"?

[Ravhin]

Phobus I think is right in this case, the parser has trouble reading people's minds =/

In any case I am implementing an "outlier rejection" algorithm to remove prices which are wildly wrong. Missing the "k" will make it 1000x smaller than normal so it will take care of those.

And bump for more logs!

[phobus]

That would be helpful - I think the Goonquest site threw out any prices outside 3 standard deviations.

I have a lot of log data collected while Goonquest has been down, but I need to split it up in order to upload it. I'll get to it soon.

Any plans for allowing people to fix/remove misspelled items, incorrect prices, etc? Maybe just for logged-in wiki users?

[Ele]

Sounds great! Now if only people would actually put prices in their auctions.

[falkun]

You've convinced me that its plausible that someone left out the "K" suffix. But bringing it up still does get the outlier issue looked at. Also, it bumps this up to the front page again, which is always good =).

Again, amazing work Ravhin!

[nocookiesforme]

I'm a little confused... are people posting logs of people /auctioning with prices, or are they posting logs of actual completed transactions? It seems like the former would give a lot more data points, but they wouldn't necessarily be as accurate. Just because people are willing to CHARGE X doesn't mean people are willing to PAY it...

[phobus]

I'm a little confused... are people posting logs of people /auctioning with prices, or are they posting logs of actual completed transactions? It seems like the former would give a lot more data points, but they wouldn't necessarily be as accurate. Just because people are willing to CHARGE X doesn't mean people are willing to PAY it...

The former. Yes, it's really only indicative of asking prices. You just have to keep that in mind when examining the data. :)

Info like this is great for giving you a price "neighborhood" for a given item. It's not necessarily going to tell you if a Froglok Bonecaster's Robe is worth 4k or 3.5k, but it will tell you that it's not worth 1k or 10k (to most people anyway).

[Rasah]

Man, this is going to make it much harder for Armani to charge 33% above market value for items...


Great work =)

This is why I have Armani on /ignore. No need to even see what he's trying to sell. Unless you absolutely have to have an item and don't care what you pay, there is really no reason to do business with him.

[ElanoraBryght]

Fantastic work - it's great to have a site for this again.

Can you look at gem and spell searches when you have a chance? Some seem to be only giving results from the item / spell part of the wiki, not the pricing data. (Black Sapphire, Diamond, all the Spell: name I tried.)

Thanks so much for the time you've put into this !

[Ravhin]

Thanks for the log uploads!

I've added a small interface so that users may delete bad entries, it's on the main page.

Note that the auction tracker will record prices even if the item page doesn't exist yet on the wiki. This was the case with gems. I added pages for BD (http://wiki.project1999.org/index.php/Blue_Diamond), D (http://wiki.project1999.org/index.php/Diamond), BS (http://wiki.project1999.org/index.php/Black_Sapphire) so that we can see their pricing.

Also changed the plot display to last 30 days.

I will add the price box to spell pages soon.

Bump for more logs!

[TheBlackSheep]

Thank you. This is really good stuff. A couple of times I had people ask me to make an offer on something I wanted to buy and not wanting to insult them, but then again, not wanting to screw myself, I was able to pull up the wiki on my other LCD and give it a good glance before hollering back at them. Easily saved me several hundred plat.

Azorath

[Ravhin]

Script running now adding pricing to spell pages, ala Allure (http://wiki.project1999.org/index.php/Allure) or Cani III (http://wiki.project1999.org/index.php/Cannibalize_III).

[Crug]

Hmm I can't even find my eqlog text files, apparently Im not saving them anywhere on my pc.

[Ravhin]

First thing I do on a new EQ install is set Log=TRUE in eqclient.ini, which turns logging permanently on. Never know when you'll want something.

[Estu]

First thing I do on a new EQ install is set Log=TRUE in eqclient.ini, which turns logging permanently on. Never know when you'll want something.

Nice, thanks for the tip. Several times I've wished I had something logged but had forgotten to turn logging on that session.

[maximum]

Now you've done it Rav... you've made me download a parser.

[jarshale]

This is why I have Armani on /ignore. No need to even see what he's trying to sell. Unless you absolutely have to have an item and don't care what you pay, there is really no reason to do business with him.

I didn't know that. Luckily the last time I was trying to buy something from him he was too busy spamming his macros to respond.

[TheBlackSheep]

I didn't know that. Luckily the last time I was trying to buy something from him he was too busying spamming his macros to respond.

I asked him for a PC on one of his items (I don't remember what it was, exactly) but I remember being so astonished that I asked him if it came with a certificate of authenticity and if he accepted Paypal.

He never responded.

Azorath

[ElanoraBryght]

Loving it.
Thank you!

[Ravhin]

Glad to see that there are (at least a few) people still uploading logs. There is now a nice collection of data. I added a little stats, which is currently:

Current stats: [78] submissions included [311833] auctions with [25171] unique item prices. Have records on [1413] items from 2010-04-19 to 2011-11-09.

I also changes the plots from showing the last 30 days to the last 60 days.

[Waffen]

Glad to see that there are (at least a few) people still uploading logs. There is now a nice collection of data. I added a little stats, which is currently:

Current stats: [78] submissions included [311833] auctions with [25171] unique item prices. Have records on [1413] items from 2010-04-19 to 2011-11-09.

I also changes the plots from showing the last 30 days to the last 60 days.

is there an auto disconnect for being afk for a certain amount of time? i remember that being the case on live. if not, i'll leave my main parked in ec while i'm at work, and get logs for you on the daily! thanks for all the work towards the wiki, and more so this new auction tool! i've been searching archived goon quest pages for my prices lately, haha.

[phobus]

I have a request: the old Goonquest tracker used a line graph to display prices, with markers for each recorded price. The graphs here don't include markers, making it hard to determine (without correlating the data points listed under the graph) if an item's price is flat for a given time period or if there's just one record.

Would it be possible to change the price graphs to include markers for each entry, and connect them with a line rather than the plateaus shown now?

[phobus]

Any idea why the page for Chipped Bone Bracelet (http://wiki.project1999.org/index.php/Chipped_Bone_Bracelet) isn't showing prices? I looked at the code and didn't see anything obviously missing, but just from checking my own logs it looks like there should be some entries.

[Lagaidh]

I notice so many sellers now don't include prices in their /auc lines.

[phobus]

Sure, but that was always the case, even before people starting using the Goonquest tracker. Some sellers are just lazy, or are hoping to get offered more than their intended asking price (hey, it's happened to me). I usually include prices unless I've got a whole bag of stuff to list and can't stick around more than a few minutes. Not worth typing it all out if you're just moving on to another zone in five minutes anyway.

[Rais]

Need to remove Richgirl from any logs or any part of the auction process on Wiki. Between this person and Armani have helped ruin prices. They sit there and spam the most insane prices *WTB King Tranix Crown 15k+* for 2 weeks, then turn around and then spam selling it for 30k+ just to raise the average selling price.

If anything this entire process is helping them with their Christmas shopping spree from selling plat for money.

[Norok]

Is this still working or has no one just updated in a while? This is a really valuable tool especially for people new to the server when trying to establish good deals on prices. I'm going to start logging and updating regularly to keep it supported.

[Ravhin]

I've updated the auction tracker as per Phobus' request to also include points at the actual data points. Also, I extended the plot range from 60 to 90 days.

Hopefully I also fixed the problem with Chipped Bone Bracelet (any item with "pp" was not getting recorded) and it will appear in future uploads.

http://wiki.project1999.org/auctiontracker/Flowing_Black_Silk_Sash.png

Still going strong, thanks to everyone who still uploads!

Current stats: [110] submissions included [462279] auctions with [35423] unique item prices. Have records on [1523] items from 2010-04-19 to 2012-01-28.

[Nips]

Thanks a lot, very cool.
Will have to upload my logs, I'm guessing they are masssive.

[phobus]

Just noticed Forest Loop (http://wiki.project1999.org/index.php/Forest_Loop) doesn't have any price data, but it should based off what's in my logs.

Oh, and BTW: the points in the price graph are much appreciated. Thanks for all the work on this!

[maximum]

2 AM bump

[Ravhin]

Just a request for continued logs, and to make sure people know about this!

Current stats: [190] submissions included [884451] auctions with [66056] unique item prices. Have records on [1805] items from 2010-04-19 to 2012-08-21.

[Kratzy]

So, just to clarify for myself. Does the tracker/parse pick up prices with pp at this point? Or do i need to leave that off when I make auctions so that it can help the wiki?

[phobus]

Bump!

I just submitted the 200th log, which took us to over 1 million auctions. Keep them coming, everyone. =)

Current stats: [200] submissions included [1007331] auctions with [76879] unique item prices. Have records on [1871] items from 2010-04-19 to 2012-10-14.

As for this:

So, just to clarify for myself. Does the tracker/parse pick up prices with pp at this point? Or do i need to leave that off when I make auctions so that it can help the wiki?

I don't know how it's coded, but it seems pretty intelligent, and appears as though 'k' and 'pp' are interpreted properly. A few prices do seem to sneak in at a thousandth of what they are probably supposed to be - i.e., an FBSS for 6 is obviously supposed to be 6000. I'm not sure how those are getting in, though.

[Swish]

Not sure what happened to the designer/programmer/etc, but a good supplement to this is to use:-


ahungry.com/eqauctions (http://ahungry.com/eqauctions) - type in the item you're looking for and see what people have been advertising it for :)

[tristantio]

I haven't been as proactive about it lately, but I normally dump all the logs that are auto-sent to the http://ahungry.com/eqauctions/ tracker back to the wiki to keep it updated as well (I should probably do that soon!)

So, in essence, if you contribute via my auto-log uploader to the ahungry eq auctions site, you are (in a roundabout way) contributing said data back to the wiki as well.

[Zadon]

What happened to this feature? Gone forever?

[phobus]

Nope; from another thread:

The 'recent changes' log in the P99 Wiki has the following entries by Ravhin:


(diff | hist) . . m Main Page‎; 10:40 . . (-43)‎ . . ‎Ravhin (Talk | contribs)‎ (disable auctiontracker temporarily)
(diff | hist) . . m Template:Itempage‎; 10:39 . . (-41)‎ . . ‎Ravhin (Talk | contribs)‎ (remove auctiontracker from items temporarily)

Key word: temporarily.

[Estu]

Small update from Ravhin's user talk page on the wiki:

Hey, I've noticed that this feature has been down for a while. Just wondering what's going on with it - ahungry is nice but not the same. Thanks! --Estu (talk) 23:23, 9 September 2013 (EDT)
Hi, the problem is just the performance, need to optimize it a bit, as the load on the server was really high. Work in progress! --Ravhin (talk) 23:56, 9 September 2013 (EDT)