It's harder to stuff up in vector components.
This is hard to talk about - I'll make up some terms:
If the initial momentum has magnitude [itex]p=m_1v[/itex] and the 0.4kg and 0.5kg balls final momenta have magnitudes [itex]p_1=m_1v_1[/itex] and [itex]p_2=m_2v_2[/itex] respectively.
Then ... using your strategy, [itex]\vec{p}=\vec{p_1}+\vec{p_2}[/itex] will give you a triangle [itex]a:b:c = p_1:p_2:p[/itex] where the angle between sides [itex]p[/itex] and [itex]p_1[/itex] is known ... call it [itex]\theta[/itex] ... the other angles are unknown so leave them be. Only, the angle between [itex]p_2[/itex] and [itex]p[/itex] is one you want to know, so call it [itex]\phi[/itex]. That's how you needed to draw that vector diagram.
As you did, the length of the third side can be determined from the cosine rule - which you did.[tex]p_2^2 = p^2+p_1^2 - 2p_1p\cos\theta[/tex]... then you can use the sine rule to find the angle [itex]\phi[/itex]:[tex]\frac{p_2}{\sin\theta}=\frac{p_1}{\sin\phi}[/tex]
I don't see anything wrong with that approach.
The only problem was that what you wrote down, and drew, made it look like you made some mistakes in your calculations.
However it is harder to stuff up when you use components.
put the y-axis in the north direction, then the x-axis points east.
Using the above notation: [itex]\vec{p}=m_1v\hat{y}[/itex] see?
Similarly for final:
[itex]\vec{p}_1 = [p_1]_x\hat{x}+[p_1]_y\hat{y}[/itex]
[itex]\vec{p}_2 = [p_2]_x\hat{x}+[p_2]_y\hat{y}[/itex]
(here: [itex][p_1]_x[/itex] is the x-component of [itex]\vec{p}_1[/itex].)
Use the 30:60:90 triangle to get the components ... that is 1:2:root-3
The final x components have to add to zero, because the x component of p is zero.
The final y components have to add to p.
This will give you two simultaneous equations and two unknowns.
Get the angle and magnitude you want from the components.
That looks like more steps, but it is usually easier to think about.
Which is why the others keep wanting you to do it that way.
------------------------
Note: I could go into a lot more detail for the cosine-rule part than I could for the components part because you had done all that work already... it's fine just check that what you wrote down accurately reflects what you actually computed.
Must be past time to hand it in by now :) good luck.