Are the samples independent? I'll assume that they are.
The samples are small size so the t-distribution should be used. Since $\displaystyle s_1^2$ and $\displaystyle s_2^2$ do NOT differ by an order of magnitude, it can be assumed that df = $\displaystyle n_1 + n_2 - 2 = 50.$
$\displaystyle \hat{\delta} = \mu_1 - \mu_2 = 0.125$.
$\displaystyle se(\hat{\delta}) = \sqrt{\frac{5.37225^2}{28} + \frac{7.69987^2}{24}} = ......$
Two tailed therefore require $\displaystyle t_{0.05} = 1.676$ (refer table given at
Student's t-distribution - Wikipedia, the free encyclopedia).
The confidence interval is $\displaystyle \hat{\delta} \pm t_{\alpha} \, se(\hat{\delta}) = .....$
Since the degree of freedom is so large you could use the z-distribution without too much error.