alingy1 said:
The next question is: why can't I rearrange them?
I was expecting this. This shows a wrong attitude towards mathematics. Don't worry, you're in good company as most ancient mathematicians had this attitude.
Your attitude is: I can do anything in mathematics as long as it looks right. For example, rearranging brackets looks right in the finite case, so it must work in the infinite case. This attitude has brought many paradoxes and contradictions to mathematics which took hundreds of years to resolve.
The modern attitude is quite the opposite. It is: you can't do anything in mathematics without first showing rigorously that you can. So if we look at this question with the modern attitude, then we notice that we can rearrange brackets for finite sums. But we also immediately remark that doesn't imply anything for infinite sums. There is no reason to expect that a property like this holds if we have no rigorous proof of it. In fact, this example alone suffices to show that the property does not hold, it is a counterexample!
This ancient versus modern attitude is very pervasive. For example, in ancient times it was thought that since stones fall towards the earth, that would imply that everything falls to the earth. Thus the Earth is the center of the universe and everything falls towards it.
The modern attitude is that there is no reason to expect things that hold for stones that they also hold for planets. It must be demonstrated somehow first. In fact, it has been demonstrated that it does not hold.
The question you pose is a very difficult one to answer. This is why I give this lengthy response which doesn't really answer anything. The difficulty lies in what you expect to be the answer. How would you answer why something is
not the case? If I were to ask you why the sun is not made of cheese, how could you possibly answer it? It is even not easy to answer why something is the case, let alone why something is not the case. So it is not clear to me at all what kind of answer you expect and what kind of answer would satisfy you. What satisfies me is to see that a counterexample exists and that the sum is infinite such that the reasoning of the finite sums do not apply. I guess that is not satisfactory for you, but I don't have a better answer than this. You must first think about this and try to formulate what kind of answer you expect to hear.
Some things to consider:
https://www.youtube.com/watch?v=36GT2zI8lVA