I have a starting hint that I think should be used for the problem:

Xn can be defined as:

Xn=Xn-1(starting inventory for week n)+N(no of 6 packs of beer purchased at the start of nth week)-Dn(Demand during week n)

How do I go about finding the transition matrix for Xn and state space from here?