Hi,
Yeah i did mean sin(alpha). I agree that if you let x'(0)=0 then A=0, however we would then need a second equation to find B and we do not know what x(0) is. We are only told that the mass is at the top of the hill, and we are given no detail as to where the top of the hill is.