A virtual particle is a particle which is not observed in an experiment, but influences the outcome.
In a Feynman diagram, these are particles that are created during an event, but are destroyed again before a measurement is taken. They are called "virtual", then, because they are never actually seen directly. They only serve to influence the final result, and to say they actually ever existed during the experiment is a question you can't answer.