Hey dexterdev.

The second diagram is a better representation.

Independent will always give you E[XY] = E[X]E[Y] and there can be overlap in orthogonality with independence. The orthogonal ones should always have the property of being un-correlated though (the covariance matrix should be diagonal for this case).