Welcome to PF, Shakermaker.
Lurch's suggestion is a good one in some ways, but might fall short in others. Primarily, I think that it would depend upon what sort of 'rubber' is involved. I've personally never seen any that would lose enough viscosity under heating to flow through a sieve. There's also the density to consider; it might or might not separate from the rocks due to either floating or sinking.
My first thought was actually to go the opposite way. If you freeze the mass, the 'rubber' should become brittle while the rocks remain unchanged. You could then whap it a few times with a hammer to get smaller chunks, then run it through a grinding mill with teeth that are made out of something just slightly stronger than the frozen rubber. They should pulverize it, while leaving the rocks intact.
Having seen Lurch's post, though, I believe that the two could be combined. If you use his process first, it would make the 'freeze separation' a lot easier.
A couple of things that you didn't specify is how large this mass is, and whether you have to salvage the rubber, the rocks, or both. If you only have to keep the rocks, for instance, I'd just burn the rubber off completely with a torch or kiln. If you have to keep only the rubber, or both, I'd use Lurch's heating method alternating with freezing and grinding. Eventually you should end up with little balls of rubber that are small enough to fall through a coarse screen that will stop the rocks.
This is just a first impression, though. Some more thought needs to go into it.