Hmmmm I do see that the program you are using for HW shows you getting the Ry of 160.651 as correct, really odd but I got Ry as 150.651...
For your moment, I'm not sure what you are actually doing here. If you attach the force at B, the original moment about O was already zero thanks to symmetry, but you now have to worry about the moment being created at O by placing the same force at B. If you look at the force components and perpendicular distances in symbolic form, you can see a bit easier I think:
\vec{F}=<\frac{Fb}{2\sqrt{b^2/4+h^2}},\frac{Fh}{\sqrt{b^2/4+h^2}}>
This I got simply by noting that F lies along line OA, so by finding the unit vector along OA and then scaling it by the force's magnitude I get the vector for force F. Additionally I can create position vectors for both points A and B, by noting their position relative to O and keeping in mind they are midpoints along each side:
\vec{OA}=<\frac{1}{2}b,h>;\vec{OB}=<b,\frac{1}{2}b>
All three of these vectors can now be used in moment equations about O. Originally I said that due to symmetrical geometry that the original position of the force creates no moment about O which you can test, but I'll skip it and just show the moment about O when the force is moved to B:
\vec{M_{OB}}=\vec{OB}\times\vec{F}=\frac{3}{4}Fbh(b^2/4+h^2)^\frac{-1}{2}\vec{k}
However, you need to counteract this moment with one placed at B, making the force couple system. This means your couple has to be opposite in direction to the created moment by the force to make a total of zero moment (the original amount when the force was at A).
If you plug all the variables in you should get a couple value of -55.4k.
About your last point, the y-component of the force definately travels through B...that's the new point of application! But you are mixing up your reasoning here. A force creates no moment through a point which lies on its line of action, so yes the force would create no moment through B...however, B is not your point of interest here, it would be any other point on the object for which you would take the moment about.