Well we don't square the mean, we square the difference between each observation and the mean.

The standard deviation describes the average variation around the mean. Conceptually its a measure of how tightly values are centred around the mean.

Two reasons we square each difference is to make them all positive and then to make the bigger differences stand out. This helps bound the smaller differences.