I'm not the best at Linear Algebra but I'll give this a crack until someone else helps you out.

I'm assuming A^t(A) to mean the transpose matrix of A. So if A is an m x n matrix then the transpose should be n x m, since the rows and columns switch.

Before I try to help, is this what you meant?