If an identical Earth magically materialized at Earth's distance, on the opposite side of the Sun, it would be in Earth's Lagrange 3 (L3) point. Mathamatically it can stay there forever if nothing perturbs it away, just like mathamatically you can demonstrate that it's possible to balance a sharp pencil on its tip. But try balancing the pencil in real life, and you'll find it impossible to do.
Similarly, the anti-Earth would not stay put for very long. It will roll off the L3 point towards either L4 or L5, and swing around L4 or L5 back to L3. If it crosses L3, it will next visit the L4 or L5 on the other side, and repeat this over and over again in what is known as a horseshoe orbit. If it fails to crest the L3 point, it will continue to loop around the L4 or L5 point in what is known as a tadpole or trojan orbit. In all cases it will be in a 1:1 resonance with the real Earth, and will make repeated close passes to the real Earth every few hundred years. This will cause both planet's eccentricities to rise to high values, which would have a huge effect on our climate. It would also ensure that history was filled with apparations of a mysterous planet that grew large enough to resolve with the naked eye, then retreated as quickly as it approached. To me, that would make very interesting si-fi.
Additionally, it only takes a very small pertubation to make the system jump from a trojan state to a horseshoe state.
As others have stated, it would be very easy to detect its presence by the way it perturbed the other asteroids or planets. The pertubations on the asteroids that DH mentions would be very noticable. And you can add to that list the Spitzer Space Telescope, whose position is extremely well known as we are constantly communicating with it. Spitzer is in a 1:1 horseshoe orbit with Earth.
And even though its perturbations on other planets would be trivial as Blackwing points out, our ability to detect this is far from trivial. We'd notice within a few weeks that Mars and Venus were not exactly where they should be.
Here's an animation of a Venus-mass planet placed directly on Earth's L3 point. Originally the Venus-mass planet dropped off the L3 point into an L4 trojan orbit. Later it was perturbed into a horseshoe orbit. The animation shows one cycle of the horseshoe state looped over and over again:
http://orbitsimulator.com/gravity/images/VL3.GIF
Here's a link to a thread describing the simulation that made this animation: http://www.orbitsimulator.com/cgi-bin/yabb/YaBB.pl?num=1189814191