Prove that the inverse of an upper triangular matrix whose diagonal entires are all 1 is itself an upper triangular matrix whose diagonal entires are all 1.

I know that we can use Cramer's rule and just crunch out the result but I was hoping that someone could provide a short and simple reason.