If P is not orthogonal then , the orthogonal complement of the kernel of P, is not equal to the range of P. Also, those two spaces have the same dimension. So there must exist a vector such that . Then . But so it is orthogonal to x. It follows (Pythagoras' theorem) that . Since , that tells you that and hence .