can i have information without probability?
is the probability based way to define information. This link will explain it better, perhaps.
From Probability and Mathematical Statistics: Kazimierz Urbanik (1930-2005)
...Since 1961, Urbanik made several attempts to define information without probability theory. These efforts finally bore fruit in 1972, when he proposed new axioms....