Begin with the definition of a metric space. Then define a probability measure on it. A probability measure is a function from the space of subsets of the metric space (intervals, regions, etc.) to the interval [0,1] such that the function obeys the axioms of probability.