This hinges on the definition of "stable". I would say that this exotic atom is stable if a) it is neutral, and b) its lifetime in its ground state is long - say one second. Using that definition, the answer is "no".
The simplest system that satisfies a) is a positron orbiting an H- ion. An H- ion has a radius almost the same size (just a tiny bit larger than) as an H atom, and the radius of an atom formed by a positron orbiting a -1 charge object is the same as an H atom. So essentially the two electrons and the positrons will be in the same orbitals, and will therefore have substantial wavefunction overlap. That means they will annihilate quickly - on positronium-like time scales: nanoseconds.
This argument extends to Z+1 electrons and one positron orbiting a nucleus of charge Z: if you're in the ground state, the positron's S-wave wavefunction overlaps substantially with all the electrons in an S-wave.