You should read again your definitions: means that is measurable and integrable with respect to the measure : . And integrable is not linked with continuous.

To show that the function is continuous at , notice that, if , (where the 1 is the indicator function). Then you can use the dominated convergence theorem, when tends to , to show that the previous integral converges to 0.