Why Exterior Neumann Problem for circle does not hold?
I have no clue what you mean by this. The "exterior Neumann problem" for a circle would be to find solutions to a given (typically second order) partial differential equation given values of the function on the circle (and, typically, the condition that the function go to 0 at infinity).