View Single Post
  #4  
Old 09-30-2011, 11:16 AM
falkun falkun is offline
Planar Protector

falkun's Avatar

Join Date: Sep 2010
Location: Ruins of Old Sebilis
Posts: 2,464
Default

Quote:
Originally Posted by wc4482 [You must be logged in to view images. Log in or Register.]
(the spreadsheet should just round to the nearest integer)
That may be your issue. I believe EQ utilizes floor(x) instead of round(x), or whatever the EQ equivalent is of those 2 matlab functions.

Examples to help make things clear:

floor(32) = round(32) = 32
floor(32.3) = round(32.3) = 32
floor(32.5) = 32, round(23.5) = 33
floor(32.8) = 32, round(32.8) = 33

Basically, until the new integer number is actually obtained through mods/levels, the next lowest is used. You can never "gain" values (damage, healing, +resist) through rounding, but you can "lose" some through the floor conversion (always <1 value lost).

Graphically, it would look like this, with the solid circles indicating inclusive on the lower step bound on the integer mark while the hollow circles indicate exclusive at the upper bound:
[You must be logged in to view images. Log in or Register.]

Do note that a rounding graph would look similar, but would be translated 0.5 units, so that x=5.5 would yield y=6, etc.
Last edited by falkun; 09-30-2011 at 11:27 AM..