My guess, as an old analog troubleshooter, is:
If it's not weak batteries,
you are hearing the power supply's oscillator.
It could be coming into the audio stage through either the high voltage circuit or the low voltage circuit. I think latter is most likely.
1. Check Low Voltage first... With device runing, place your DMM across C6 and write down what you get . You ought to read about 15.5VDC ..
2. Then switch meter to read AC volts, write down what you get. You ought to read less than 10% of the DC value.
If you read more AC than that , tack a capacitor of at least same value as C6 across C6 and repeat readings.
That will tell you whether C6 is open. And if your meter is "True RMS" it may report the DC content of voltage check the manual.
3. If steps 1 and 2 go okay,
check for noise on the the high voltage by temporarily connecting base and emitter of V2 together.
If that quiets things down, the noise is probably coming in through R12-C5 path. CR5 may be shorted or C8 may be open.
I think it's a long shot, but check R5 and R8. You can measure them in circuit with board de-powered. Read both directions...if you read more than the value of the resistor in one direction it's open. Other direction you'll read less because of parallel paths through the transistors.
Please post results of those three steps - there's lots of enthusiastic help here.
I like a Simpson 260 for troubleshooting...
To check for AC in the power supply, step 2, move meter red lead from "+" jack to "Output" jack above polarity switch. That connects a capacitor in series to block DC, specifically for that type measurement. Very handy. It's only a 400 volt capacitor so don't try that on your HV supply.