In fact, you're looking for this probability :
(where M is the maximum area in sq. ft. of the pizza), which is, by definition of the pdf :
Assuming that the box is a square, you're correct in finding the value
So now just calculate (because , so you're in an interval contained in (0,1) and hence )
and you'll have the proportion (or probability) you're looking for.