No, it's not a matrix! Perhaps it wasn't written clearly in your book. Here denote square matrices of dimensions (where , , and denotes a matrix of appropriate size filled with 's.
You have the correct first step. Now by assumption, can be written with only... what will that look like in the matrix?