Can we apply non-linear smoothing to a linear looking like data ?

Click For Summary
SUMMARY

This discussion addresses the application of non-linear smoothing techniques to data that appears almost linear, specifically in the context of statistical analysis. The original poster, Paawan, questions the validity of using a multiplicative factor to enhance linear correlation in their dataset. Responses indicate that while non-linear smoothing can strengthen linear correlations in some cases, it may weaken them in others, depending on the specific characteristics of the data. The consensus suggests that defining a clear mathematical goal is essential for determining the appropriate smoothing method.

PREREQUISITES
  • Understanding of non-linear smoothing techniques
  • Familiarity with linear regression models
  • Basic knowledge of statistical analysis
  • Experience with data manipulation and transformation
NEXT STEPS
  • Research the application of non-linear smoothing methods in statistical analysis
  • Explore the use of quadratic regression models, specifically Y = a + bx + cx²
  • Learn about the minimization of residuals in regression analysis
  • Investigate the implications of data transformation on correlation strength
USEFUL FOR

Data analysts, statisticians, and researchers interested in enhancing data analysis techniques and understanding the effects of smoothing on linear correlations.

paawansharmas
Messages
19
Reaction score
0
My doubt is that whether we can apply non-linear smoothing to a almost linear data ( without one or 2 discontinuity)

I have attached the pic in which the red data is the smoothed one. Blue is the original one.
I multiplied each point with an increasing like 1, 1.1, 1.2, 1.3, 1.4...so on

My question is : is this valid way to remove discontinuity or to make a linear correlation stronger ??

thanks


attachment.php?attachmentid=57466&stc=1&d=1365086771.jpg
 

Attachments

  • 2pf.JPG
    2pf.JPG
    12.4 KB · Views: 505
Physics news on Phys.org
It really sounds like a question in the science of statistics.

For some series it'll make the linear correlation stronger, for some weaker. It probably depends on the effect you want, or the features you want to find in your data.

Statistics can also help you choose the correct coefficients for whatever kind of dampening.

So I advise you to ask this again in (or move the thread to) the statistics forum.
 
Thanks Amir.
But i do not know how to move it to other forum.
and if I write same thread in another forum , I will get warnings for multiple posting.

please help.

Thanks
Paawan
 
paawansharmas said:
My doubt is that whether we can apply non-linear smoothing to a almost linear data ( without one or 2 discontinuity)

To move a thread, you can use the "report" feature (even though the directions for report sound like it is only to be used to report naughty things) and "report" that you would like your thread moved.

You have not defined a mathematical problem. It isn't clear what you are trying to accomplish.

To take a silly point of view, you can do anything you want with the data. You could erase each value and write in a different number that pleases you! However, your question suggests you think only certain procedures will accomplish your goal. But what is the goal?
 
The answer to your question is 'yes'. Your curve looks like having a quadratic component. Take your model as Y= a+ bx + cx^2. Minimize sum[(y-Y)^2] with respect to a,b,c, where y= observed values.
 

Similar threads

  • · Replies 3 ·
Replies
3
Views
2K
Replies
2
Views
3K
  • · Replies 6 ·
Replies
6
Views
2K
Replies
2
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 1 ·
Replies
1
Views
6K
  • · Replies 12 ·
Replies
12
Views
9K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 69 ·
3
Replies
69
Views
9K