In normal operation, these small back up systems do a little filtering and just feed the incoming AC to the output sockets. When the incoming power disappears, they switch to the battery-powered inverter. So in normal operation the won't help much, if any. There are (larger) models that operate continuously so the output is always relatively clean, and no switch-over transient. (more $$$ though)
You would be better off buying a Constant-Voltage sine wave transformer, the low power ones are available from 30W thru 7,500W, but they are not cheap.
I actually had to do this for a computer installation back around 1976. It was a business (a service bureau) that had an Open House introducing their new services.
It also happened to be the first warm Spring day. The power line voltage sagged when everyones air conditioner came on.
Oops! Between the voltage sag and a marginal computer power supply, the "New" computer wouldn't even boot-up. Two days later the whole system was on a Constant-Voltage (CV) transformer.
Everyone was (mostly) happy.
Here is a datasheet link to one of the major US suppliers of Constant-Voltage (CV) transformers:
https://www.appleton.emerson.com/do...usoidal-transformers-solahd-en-us-7438572.pdf
You MAY be able to find an industrial grade Line Conditioner or Line Filter that would be adequate for a lower cost. Hopefully someone else here has better information/sources for those.
Cheers,
Tom
p.s. Historically, one of the main reasons device manufacturers don't recommend electronics usage with a generator is that some generators are/were prone to voltage spikes on their output lines. Then the consumer complains about a short lifetime and wants a warranty replacement of the electronic device.