As seen in the picture, this question is about an object moving in the x-y plane. But I don't get why in equation 8.9 the cross terms vanish? If anyone can help me, that would be really nice.
... they vanish due to the definition of "center of mass".
The text explains with maths in the passage right below eq8.9.
Have you tried working out the cross terms for some example?
The book answers your question already. You need to think about the center of mass in the center of mass frame of reference. Also the author suggests hou look at equation 5.56
I get why r' is zero in the frame of the center of mass. But if that's the case, why is the integral of the cross product of r' and v' not equal to zero also?