Joint density h(z1,z2) can be factored out as g(z1)q(z2)

then z1 and z2 are indepent without finding marginals.

Why is that?

Printable View

- March 9th 2009, 05:38 PMninano1205Can anyone explain this?
Joint density h(z1,z2) can be factored out as g(z1)q(z2)

then z1 and z2 are indepent without finding marginals.

Why is that? - March 9th 2009, 08:20 PMmr fantastic
Read page 11: http://www.colorado.edu/Economics/mo...intdensity.pdf

- March 9th 2009, 09:37 PMmeymathis
Well, I'm not sure whether the OP meant:

1) Suppose you can write the joint density function of and , as the product . Show and are independent.

or 2) Suppose you can write the joint density function of and , as the product where and are PDF's of and respectively. Show and are independent.

#2 is answered by that white paper (from my alma mater!), but #1 is not. Even if the OP meant #2, I like #1 better! It seems like it should be true, but I haven't been able to work out the proof. - March 10th 2009, 12:03 AMmatheagle
I've known this for 20 years. But I have no idea where the proof is.

This is for continuous rvs.

If the joint density factors into two function, that consist solely of the two variables AND the region is a rectangle.

(That's important. And it can be an infinite rectangle.)

Then the two rvs are independent.

That's why I knew...

f(x,y)=c on meant that X and Y were dependent.

That's a triangle and not a rectangle.

A rectangles means a<x<b and c<y<d, hence there is no relationship between x and y.

Likewise on x>0, y>0 means that they are independent and one can see that these are iid exponential (1) rvs. - March 10th 2009, 01:32 AMmatheagle
I was about to go to bed, but I decided to prove it myself.

Say , where g and h may not be the marginals. Also a<x<b and c<y<d is our support.

Then by integration we have

and

.

Thus

.

Or

, where

and .

Now take the double integral to show that , i.e.

leaving us with .

I haven't seen this theorem in any book in 20 years.

I asked a colleague about it and he said it's in Hogg's book.

I just found it on page 77 of the THIRD edition.

The proof is exactly what I did two days ago. - March 10th 2009, 01:52 PMMoo
Hello,

This is what I remember... It involves Fubini's theorem for integrals... And I'm sorry, it involves bits of measure theory ^^'

Assume that g and q are pdf, that is their integral is 1.

Let be a measurable, positive and bounded function.

(by the "transfer formula") ----- you can skip the red part if you don't want to hear of measure.

now define f such that

since a density is integrable and that f is measurable, then we can use Fubini's theorem :

So again, using the "transfer formula", we get that the pdf of is

Similarly, we can get the pdf of equal to

and so we have the joint probability function which is equal to the product of the two marginal pdf.

Thus and are independent.

Does it look correct and understandable ? (Surprised)

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

The "transfer formula" says that if X has a pdf h, and if f is a measurable bounded function, then :

(the reciprocal is true, that is if you find an expression of the expectation like this, then h is the pdf of X) - March 11th 2009, 04:28 PMmatheagle
If f(x,y) factors and you're not on a rectangle.

Then the variables are dependent.

For example let on .

The support must be a rectangle. - March 11th 2009, 07:17 PMmeymathis
Matheagle, but that function doesn't factor if you write the PDF over without a "support clause".

Where

Your point is well taken though. You have to be careful when you look at a joint PDF to decide whether it factors or not.

Also, in your proof, you don't say so, but I assume that the support doesn't have to be finite. It looks to me like the proof works in that case as well so long as are finite. - March 11th 2009, 08:27 PMmatheagle
Correct, that's why you need a rectangle region.

But my undergrads don't like these indicator functions.

I just let them examine the joint density and the region.

This way they can tell in a second whether the rvs are indep or not.

What's suprising is that this basic theorem is not mentioned in

Walpole, Wackerly....

Yet the a basic version of the Central Limit Theorem is proved.

And moreover these books waste your time asking to check if the rvs are

indep by finding the marginals and that's just silly.

And in Hogg's book, he uses the infinities instead of a,b,c,d.

My a,b,c,d need not be finite.

I thought about the cases of G and H going to infinity as insert our bounds,

but since this is a finite measure I don't think thats possible.

This is why I looked at Hogg's book.

I was wondering about those cases, but our densities are well behaved functions.