Results 1 to 2 of 2

Math Help - Stepwise regression?

  1. #1
    Newbie
    Joined
    Feb 2010
    Posts
    4

    Stepwise regression?

    Hello,
    I have a large amount of data that I wish to analyse. The data is structured as follows:


    • 1 dependent variable
    • 9 independent variables
    • The independent variables are categorical and not of the same size. That is, one category has 4 values, one has 10, one has 8 etc.
    • The dependent variable is numeric (quantitative)
    • Approx 15,000 data points, representing various, but not all, combinations of the 9 independent variables.


    I want to work out what is the relevant impact of each of the independent variables. Common questions will be: “What is the effect of having value X compared to value Y”, “Which variable has the largest effect on the dependent variable?” etc.

    I was advised that stepwise regression would be the best approach, however I believe that to use this all the categories must be the same size. Is this true?

    I am at a total loss as to how to tackle this, any suggestions appreciated!

    Thanks
    JP
    Follow Math Help Forum on Facebook and Google+

  2. #2
    Member
    Joined
    Oct 2009
    Posts
    95
    What you are looking to do is pretty common in statistics and is referred to as correspondence analysis.

    My first stab at analysing data is always to perform PCA (Principle Component Analysis) on it. However, PCA is only applicable if your data can be assumed to be continuous in its domain. I don't know much about stepwise regression, but I found a paper on an extension of PCA to categorical data here: http://www.dm-lab.ws/www/contents05/covEigGiniRep16.pdf .

    Furthermore, if you are looking for a stats package that can perform correspondence analysis, R does it and is freely available: http://www.r-project.org/ .

    I found a disussion on correspondence analysis in R here: http://www.jstatsoft.org/v20/a03/paper .
    Follow Math Help Forum on Facebook and Google+

Similar Math Help Forum Discussions

  1. Ncaaf multiple regression/ stepwise regression
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: August 10th 2011, 07:21 AM
  2. euler stepwise method
    Posted in the Differential Equations Forum
    Replies: 3
    Last Post: May 12th 2010, 10:38 AM
  3. Regression SS in multiple linear regression
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: June 20th 2009, 01:23 PM
  4. Stepwise variable selection
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: June 4th 2009, 05:40 AM
  5. Help with Regression
    Posted in the Advanced Statistics Forum
    Replies: 3
    Last Post: December 7th 2007, 05:56 AM

Search Tags


/mathhelpforum @mathhelpforum