Chronos said:
Many people fail on their first try. Few show enough initiative to recognize and correct their errors.
On other other hand, sometimes the way to win is to give up and do something different.
If the OP's question was "Come hell or high water, I'm getting my physics Ph.D., how do I do it?" that's a very different question from "I don't know what to do, and I'm exploring my options."
Getting a physics Ph.D. under ideal conditions is a painful, brutal experience, and you aren't realistically going to expect anything in the end except getting the Ph.D. If you have already been kicked out, it's going to be ten times as hard. If you are absolutely committed doing it, that's something that I admire. On the other hand, if you have any doubts about it, then maybe it's a good idea to just do something else.
I suggest recruiting a sympathetic sponsor at the grad school of your choice. If you can convince them of the reason and effectiveness of action taken to correct your initial lack of performance, you have a leg up on the process. At very worst you may get a favorable recommendation for another grad school.
This is a good strategy, but there is a huge catch. If someone goes to bat for you, then you owe them. You owe them a lot. If you bother someone and ask for them to put their time and reputation on the line for you, then it is absolutely essential that you make them look good. If you ask someone to write recommendation letters and serve as your champion, and then you screw up again, you've not only screwed over yourself but someone else.
It's a tiny community, and if someone puts their reputation and credibility on the line for you and it blows up, then people will remember that.
If someone writes a massively favorable recommendation for you, and you blow up, it's going to kill the credibility of any recommendations they write for other people. Conversely, any professor is going to think twice about going to bat for you if they are not convinced that it's worth it. If you are totally committed to getting the Ph.D. and will go through hell to do it, you may find someone to help you, but if you aren't, people are going to be reluctant to help you because they will get plastered if you blow up.