Let be a random sample from a distribution with mean and variance . Then, in the limit as , the standardized versions of and have the standard normal distribution. That is and .
My question is, why should this be the case? Why shouldn't and have a lognormal distribution, an exponential distribution, etc..?