Hi
@DavidMartin,
I read your paper and was surprised by its topic and how well you laid out your reasoning. I hope you're trying to get it published. Sadly, at PF we cannot review any unpublished papers or personal theories. Consequently, I've had to remove the link to your paper.
Please take some time to read our site's global guidelines. PF is a great site, but it is also highly moderated. Our global guidelines cover most of the dos and don'ts here. We limit our discussions to peer-reviewed papers published in reputable journals. All others we remove from the site.
---
I mentioned earlier that I had read your paper briefly and was surprised to see it was on data compression. I'm a retired software engineer who worked in the related field of data communications. However, more recently and relevantly, I'm in a PhD program at a local university, and just last semester (my first semester), I did a rotation project on Polynomial Regression of scientific data. Some of my work was gleaned from a paper by Bello et al., whose team developed a linear regression data compression algorithm for single-board computer hubs as part of a project to collect utility data from 780 million households in England for near-realtime analysis of the grid.
My project was to compare polynomial regression on scientific F32 data with several well-known compressors, including gzip, SZ(3), ZFP, and PFPL. My program was no match for any of them. In general, when the data is smooth and slowly changing, you can get impressive results, though the well-known compressors still excel. But when the data is more chaotic, it becomes very hard to find the right algorithm for compression, and polynomial regression was not the right choice.
I did a project pivot by suggesting that carefully applied polynomial regression could reveal data structure, giving it an edge in data analysis. I thought of it as the DNA of the data: apply quadratic regression to extrema, linear regression to monotonically changing data, and higher-degree polynomials to more chaotic regions.
Here's the Bello paper:
https://www.sciencedirect.com/science/article/abs/pii/S2352467722001540
You mentioned you are an independent researcher. What does that mean? Are you a retired engineer? Or a former graduate student?
It was refreshing to see your paper.
Take care,
Jedi