You may have gotten credit for 480 m from your professor, but this doesn't make the answer correct. Here is why. When you solve the quadratic ##287=\sqrt{3}x-\frac{2g}{100^2}x^2##, you get ##x_1=221~\mathrm{m}## and ##x_2=663~\mathrm{m}##. They are the two distances from the cannon at which the cannonball is 287 m vertically above the cannon. At 221 m, when the ball is ascending, it just grazes the upper outside corner of the wall;. At 663 m when the ball is descending, it will also hit the outside edge (we assume a point ball here) unless you move the canon closer by 10 m in which case the ball will graze the inside corner.
Answer: x
max = 653 m from the outer face of the wall.
Do with this information what you wish. As I was writing this, I noted the post by
@haruspex and we agree.