ideal voltmeters should have infinite resistance so as not to alter current but real voltmeters have finite resistance.does our voltmeter, in any way, still alter the current flowing through our set-up?
I assume that the source of EMF that you have in mind is a battery. Batteries have internal resistance and if there is current flowing through the battery then, by Ohm's Law, there must be a potential difference across the resistance.
Yes, the potential difference across the battery will decrease but still the emf of the source remains the same. The emf of a source is the energy supplied by the source per unit charge and is measured by the potential difference across the terminals, when no current is flowing through the source.