Not sure if this is the appropriate forum, let me know...
I'm considering changing a component in a model I built. The model is used to predict performance of baseball players.
Let's use batting average as an example...
The goal of the weighting is to give more credit to younger players who 'break out'. As in, if the aging curve predicts the average player will improve by .015 points of batting average between ages 18 and 19, and Player X improved by 40 points, I want this season weighted more aggressively in the model that predicts batting average. Basically, I'm using the degree of breakout to effect the degree of weighting; (Improvement)/(Expected Improvement)= weighting multiplier, with a maximum of 3x the previous season's weight.
The problem I run into, is that as the years go by, slightly older players are only expected to have tiny improvements. As in, between the ages of 25 and 26, normal aging predicts only a gain of .002 batting average (ie from .260 to .262). So, a huge percentage of these players will appear to have 'broken out' under the methodology I currently use, which is undesirable. Any idea how I could/should work around this?
Much appreciated, folks.