we've got something in common: I never studied statistics too. Therefore my explanations are probably(!) a little bit simple. A further remark on the following text: I live in Germany and think and write in German; to write to you I've to translate my text into English. And I know that there are missing a lot of specific words. So sorry.
But maybe you get a hint where you can start to study.
Empiric (Statistical) Law of Large Number
If you have independent experiments and you count the desired outcome A exactly a times, than the relative frequency is .
If you repeat the experiments under exactly the same conditions, you'll find, that the relative frequency will stabilize(?) in a narrowing interval. The relative frequency could be considered as a estimated value of p(A) (the probability of A)
The Weak Law of large Numbers (Bernoulli's Law)
If you have a Bernoulli-chain(?) (a Bernoulli-experiment is repeated very often, this is called in German a chain) with the probability p for the desired outcome A and the relative frequency of the observed outcomes A .
where ε is the relative error (aberration?).
The Strong Law of large Numbers (Borel's Law)
where p is the value of the probability of the desired outcome A.
The inequality above can be transformed into
put into the inequality
For a fix β and a fix n you'll get for every p an interval
where you can find with the probability of at least ß the value of f(A).
If you consider the pairs (p, f(A)) as coordinates of points you'll get an ellipse. I've attached below such an ellipse for ß = .95 and n = 125.
the inequality could be transformed into:
Notice that the RHS of the inequality is independent from p.
Let for instance be
This equation describes the probability (by a given n) with which the relative frequency f(A) will be found in the interval
In the example:
n: 10 1000 10000 100000
ε: .5 .158 .05 .016
You'll get a so called 99%-funnel. I've attached below the graph of this funnel.
I hope this text could help a little bit further on.