Don't forget "distilled water" is quite often not what you think it is. In fact it can be distilled, or RO or DI water. Then, it can be ultra pure water. Each of these has slightly different combination of contaminants (similar, but not repetable between samples from different sources).
Next problem: such water if allowed to contact with air, quite fast gets saturated with carbon dioxide. That lowers pH to around 5.5, changing half reaction potentials. In theory these changes should cancel out (same change on both electrodes), but you have to know that you are no longer working with pure water.
Next problem: really pure water has very high specific resistance (ultra pure is sometimes listed as 18MΩ water, not without a reason). While it doesn't change half reaction potentials, it forces you to use high voltage just to force any current flowing through the system.
And finally - as mgb_phys pointed out - a lot depends on the electrode material and finish. As far as I am aware it hasn't anything to do with cavitation, rather with activation energy, google electrochemical overvoltage.