Results 1 to 9 of 9
Like Tree1Thanks
  • 1 Post By romsek

Thread: Gradient of Multiple Linear Regression Vectorized Version of ALS Update Formulas

  1. #1
    Newbie
    Joined
    Aug 2015
    From
    Philippines
    Posts
    7

    Gradient of Multiple Linear Regression Vectorized Version of ALS Update Formulas

    Based on the attached image, how do we differentiate/get the gradient of the cost function $\displaystyle \min\limits_{x\geq0}||y-\bar{A}x||^2_2$? Refer to the attached image for the exact update rule function for both Matrices.
    Attached Thumbnails Attached Thumbnails -screen-shot-2015-08-18-1.57.50-am.png  
    Last edited by zerofrey; Aug 17th 2015 at 10:13 AM.
    Follow Math Help Forum on Facebook and Google+

  2. #2
    MHF Contributor
    Joined
    Nov 2013
    From
    California
    Posts
    6,581
    Thanks
    2913

    Re: Gradient of Multiple Linear Regression Vectorized Version of ALS Update Formula

    Quote Originally Posted by zerofrey View Post
    Based on the attached image, how do we differentiate/get the gradient of the cost function $\frac{1}{2} min_x>=0||y-A'x||^2_2$ ? refer to the attached image for the exact update rule function for both Matrices.
    reposted to correct latex
    Follow Math Help Forum on Facebook and Google+

  3. #3
    Newbie
    Joined
    Aug 2015
    From
    Philippines
    Posts
    7

    Re: Gradient of Multiple Linear Regression Vectorized Version of ALS Update Formula

    @romsek - Wrong latex. There's no 1/2. Please don't just edit something you are uncertain of. If you don't know the answer, better yet don't interrupt. This is a serious concern.
    Follow Math Help Forum on Facebook and Google+

  4. #4
    MHF Contributor
    Joined
    Nov 2013
    From
    California
    Posts
    6,581
    Thanks
    2913

    Re: Gradient of Multiple Linear Regression Vectorized Version of ALS Update Formula

    You used the wrong tags for this forum and I corrected that.

    Blow it right out your ass buddy.

    A serious concern... Quick Robin to the Internet!
    Follow Math Help Forum on Facebook and Google+

  5. #5
    Newbie
    Joined
    Aug 2015
    From
    Philippines
    Posts
    7

    Re: Gradient of Multiple Linear Regression Vectorized Version of ALS Update Formula

    reposted to correct latex - This was what you said not a problem of tag.
    Follow Math Help Forum on Facebook and Google+

  6. #6
    MHF Contributor
    Joined
    Nov 2013
    From
    California
    Posts
    6,581
    Thanks
    2913

    Re: Gradient of Multiple Linear Regression Vectorized Version of ALS Update Formula

    Quote Originally Posted by zerofrey View Post
    reposted to correct latex - This was what you said not a problem of tag.
    it's what I always write when someone uses the wrong tags. Usually [math] [\math] instead of \$ \$.
    Follow Math Help Forum on Facebook and Google+

  7. #7
    Newbie
    Joined
    Aug 2015
    From
    Philippines
    Posts
    7

    Re: Gradient of Multiple Linear Regression Vectorized Version of ALS Update Formula

    Wait a minute, how do you define tags? For me it's different from latex. Why did you say I had a mistake in my latex? Can you pinpoint as to where? All I see is you put (1/2) prior to the min function.
    Follow Math Help Forum on Facebook and Google+

  8. #8
    MHF Contributor
    Joined
    Nov 2013
    From
    California
    Posts
    6,581
    Thanks
    2913

    Re: Gradient of Multiple Linear Regression Vectorized Version of ALS Update Formula

    Quote Originally Posted by zerofrey View Post
    Wait a minute, how do you define tags? For me it's different from latex. Why did you say I had a mistake in my latex? Can you pinpoint as to where? All I see is you put (1/2) prior to the min function.
    Looking carefully at the LaTex in each post I can see they are identical.

    All I can assume is that embedding your code inside the tags seems to have messed up the interpreter.

    I read your post. Like so many others it used the wrong LaTex coding delimiters (I call them tags) and your LaTex was just showing up as error.

    I fixed it just as I have many other posts simply by cutting and pasting your code and changing the delimiters.

    I'm not sure why your original post looks ok now. You or someone must have edited since.

    My problem with you is coming in here and telling me not to interrupt like you own the bloody place. Is that how you acts in real life?

    If you have some issue behave like a civilized person and ask what the problem was.
    Thanks from Matt Westwood
    Follow Math Help Forum on Facebook and Google+

  9. #9
    MHF Contributor
    Joined
    Nov 2013
    From
    California
    Posts
    6,581
    Thanks
    2913

    Re: Gradient of Multiple Linear Regression Vectorized Version of ALS Update Formula

    Quote Originally Posted by zerofrey View Post
    Based on the attached image, how do we differentiate/get the gradient of the cost function $\displaystyle \min\limits_{x\geq0}||y-\bar{A}x||^2_2$? Refer to the attached image for the exact update rule function for both Matrices.
    I'm not quite sure what you are asking.

    The gradient of the norm you have there, i.e.

    $\nabla \|y-\bar{A}x\|_2^2 = -2(\bar{A})^T(y-\bar{A}x)$

    in order to find the x that minimizes this norm you have to solve for the gradient equal to 0 and this solution is clearly $\hat{x}=(\bar{A})^{-1}y$
    Follow Math Help Forum on Facebook and Google+

Similar Math Help Forum Discussions

  1. Multiple linear regression calculation
    Posted in the Advanced Algebra Forum
    Replies: 5
    Last Post: Feb 12th 2010, 01:47 PM
  2. Regression fundamentals (linear, non linear, simple, multiple)
    Posted in the Advanced Statistics Forum
    Replies: 13
    Last Post: Nov 12th 2009, 06:47 AM
  3. Regression SS in multiple linear regression
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: Jun 20th 2009, 12:23 PM
  4. Multiple Linear Regression
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: Apr 27th 2008, 09:12 AM
  5. Multiple Linear Regression
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: Mar 11th 2008, 02:01 AM

Search Tags


/mathhelpforum @mathhelpforum