Results 1 to 6 of 6

Math Help - Accuracy of a Model

  1. #1
    Junior Member
    Joined
    Jan 2009
    Posts
    44

    Accuracy of a Model

    If I have some actual data, and a model produced by someone else how do I measure the accuracy of their model?
    Follow Math Help Forum on Facebook and Google+

  2. #2
    Master Of Puppets
    pickslides's Avatar
    Joined
    Sep 2008
    From
    Melbourne
    Posts
    5,236
    Thanks
    29
    You should make a similar model that you know the accuracy of then compare it. If you have paid someone to create the model for you then asking for a measurement of confidence in the model would not be unfair.

    What kind of data do you have? What kind of model is it?
    Follow Math Help Forum on Facebook and Google+

  3. #3
    Junior Member
    Joined
    Jan 2009
    Posts
    44
    I have research data with 1000s of questions and answers, I then want to measure the accuracy of a model produced by CACI they have 100's of variables. Some are actual data and others a modelled based on their actual data. Mainly demographic data like, age, household income and some binary answers like gender.

    I don't want them to tell me what the confidence in data is. I would like to test it myself. And produce some kind of measurement of accuracy for each variable.
    Follow Math Help Forum on Facebook and Google+

  4. #4
    Junior Member
    Joined
    Jan 2009
    Posts
    44
    Is there a formula I should be using?
    Follow Math Help Forum on Facebook and Google+

  5. #5
    Master Of Puppets
    pickslides's Avatar
    Joined
    Sep 2008
    From
    Melbourne
    Posts
    5,236
    Thanks
    29
    There are many types of analysis you can do with a big data set. When looking at a very simple data set i.e. one binary variable you can set up a simple pie chart to analyse the proportion of respondents. Or you can compare different variables that may have different metrics to find correlations.

    You can make some models to help you make predictions. The most common type would be a linear regression model. Have a look at Linear regression - Wikipedia, the free encyclopedia ms Excel will make the model for you.
    Follow Math Help Forum on Facebook and Google+

  6. #6
    Flow Master
    mr fantastic's Avatar
    Joined
    Dec 2007
    From
    Zeitgeist
    Posts
    16,948
    Thanks
    5
    Quote Originally Posted by RhysGM View Post
    If I have some actual data, and a model produced by someone else how do I measure the accuracy of their model?
    Ask for the value of the correlation coefficient.
    Follow Math Help Forum on Facebook and Google+

Similar Math Help Forum Discussions

  1. Accuracy question
    Posted in the Statistics Forum
    Replies: 5
    Last Post: August 7th 2010, 07:21 AM
  2. accuracy
    Posted in the Math Software Forum
    Replies: 3
    Last Post: July 12th 2010, 01:53 AM
  3. Statistical test for Model Prediction Accuracy
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: May 21st 2010, 11:43 AM
  4. Replies: 3
    Last Post: April 15th 2009, 02:18 AM
  5. methods for extrapolating model accuracy
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: September 4th 2008, 07:46 AM

Search Tags


/mathhelpforum @mathhelpforum