Results 1 to 5 of 5

Math Help - Asymptotic distributions of MLEs

  1. #1
    Newbie
    Joined
    Aug 2010
    Posts
    23

    Asymptotic distributions of MLEs

    Hello all! Having a problem with general MLE concepts. See if you can help me with this.

    Let X1,...Xn be a random sample of size n where Xi~BIN(1,p). How do I find the Asyptotic distribution of the MLE of p?

    Thanks for any help!
    Follow Math Help Forum on Facebook and Google+

  2. #2
    MHF Contributor matheagle's Avatar
    Joined
    Feb 2009
    Posts
    2,763
    Thanks
    5
    the MLE is \hat P which is an sample mean of Bernoulli's

    So {\hat P-P\over \sqrt{{pq\over n}}}\to N(0,1)

    and by Slutsky's Theorem

    {\hat P-P\over \sqrt{{\hat p\hat q\over n}}}\to N(0,1) as well.
    Follow Math Help Forum on Facebook and Google+

  3. #3
    Senior Member
    Joined
    Nov 2010
    From
    Hong Kong
    Posts
    255
    Quote Originally Posted by matheagle View Post
    the MLE is \hat P which is an sample mean of Bernoulli's

    So {\hat P-P\over \sqrt{{pq\over n}}}\to N(0,1)

    and by Slutsky's Theorem

    {\hat P-P\over \sqrt{{\hat p\hat q\over n}}}\to N(0,1) as well.
    That looks like the formula \sqrt{n}(\hat{\theta}-\theta)\sim{N}(0,I_Y^{-1}(\theta)) adapted to Bin(1,p) for n observations, or, \sqrt{I_Y(\theta)}(\hat{\theta}-\theta)\sim{N}(0,1) for large n

    (with MLE= \hat{p} and Fisher information I_Y=\frac{1}{p(1-p)} for one observation, so I_Y=\frac{n}{p(1-p)} for n observations)

    So, does the former ( \sqrt{n}(\hat{\theta}-\theta)->N(0,I_Y^{-1}(\theta))) comes from Slutsky theorem? I just never seen this name before, and I was also given the above assymptotic formula without explaining where it comes from.
    Follow Math Help Forum on Facebook and Google+

  4. #4
    MHF Contributor matheagle's Avatar
    Joined
    Feb 2009
    Posts
    2,763
    Thanks
    5
    The Central Limit Theorem gives you

    {\hat P-P\over \sqrt{{pq\over n}}}\to N(0,1)

    replacing the p's and q's with their sample versions also converges in distribution to
    a standard normal since

    \hat P\to P and 1-\hat P\to 1-P by either law of large numbers

    all you need is convergence in probability http://en.wikipedia.org/wiki/Slutsky's_theorem
    Follow Math Help Forum on Facebook and Google+

  5. #5
    Senior Member
    Joined
    Nov 2010
    From
    Hong Kong
    Posts
    255
    Ah! then, that assymptotic formula with Fisher information in it looks just like a version of the Central Limit Theorem. (edited: but of course it would, because it originates from CLT, I just didn't see the proof so I didn't see that it does. Sorry for off-top).
    Last edited by Volga; March 18th 2011 at 12:40 AM.
    Follow Math Help Forum on Facebook and Google+

Similar Math Help Forum Discussions

  1. Asymptotic
    Posted in the Differential Geometry Forum
    Replies: 4
    Last Post: March 30th 2011, 01:02 AM
  2. MLEs for a Geometric distribution
    Posted in the Advanced Statistics Forum
    Replies: 3
    Last Post: March 12th 2011, 07:58 AM
  3. Combining MLEs question
    Posted in the Advanced Statistics Forum
    Replies: 1
    Last Post: March 7th 2011, 08:03 AM
  4. MLEs
    Posted in the Advanced Statistics Forum
    Replies: 9
    Last Post: June 14th 2009, 03:06 PM
  5. Asymptotic joint distributions
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: April 2nd 2009, 05:10 PM

Search Tags


/mathhelpforum @mathhelpforum