What Are the Pros and Cons of Non-Parametric Methods in Statistics?

  • Context: Undergrad 
  • Thread starter Thread starter CuriousArv
  • Start date Start date
  • Tags Tags
    Regression
Click For Summary

Discussion Overview

The discussion revolves around the advantages and disadvantages of non-parametric methods in statistics, with a focus on understanding specific points from a referenced paper. Participants explore the implications of these methods in hypothesis testing versus effect estimation, as well as the assumptions underlying parametric and non-parametric approaches.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested
  • Homework-related

Main Points Raised

  • Some participants note that non-parametric methods require fewer assumptions about data distribution compared to parametric methods, which may be beneficial in certain situations.
  • There is a suggestion that non-parametric methods can handle outliers better than parametric methods.
  • Participants discuss the intuitive nature of non-parametric methods for small samples, although this may not hold for larger datasets.
  • One participant raises a question about the difference between the unknown distribution and the unknown form of the functional in non-parametric methods.
  • Another participant illustrates the limitation of non-parametric methods in estimating effect sizes, using an example involving weight loss treatment and energy levels measured on a categorical scale.
  • There is mention of the rank ordering of data in non-parametric tests, which does not require knowledge of the underlying distributions.

Areas of Agreement / Disagreement

Participants express varying levels of understanding regarding the implications of non-parametric methods, particularly in relation to hypothesis testing and effect estimation. There is no consensus on the clarity of certain points, and some participants seek further examples and explanations.

Contextual Notes

Some participants indicate that the discussion may be too broad, with requests for more focused questions. There are also indications that the complexity of the topic may lead to confusion regarding the assumptions of different statistical methods.

Who May Find This Useful

This discussion may be useful for students or researchers in statistics who are exploring non-parametric methods and their applications, particularly in the context of hypothesis testing and data analysis without strong distributional assumptions.

CuriousArv
Messages
53
Reaction score
0
Hello all

I am forced to get famiilar with this topic quickly and I am struggling with the following after reading it in a paper. Can someone help with the underlined ones. I also have a follow up question which I will introduce after this.

From the paper: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC153434/, i saw the following and wanted to get clear.

Advantages of nonparametric methods

Nonparametric methods require no or very limited assumptions to be made about the format of the data, and they may therefore be preferable when the assumptions required for parametric methods are not valid.

Nonparametric methods can be useful for dealing with unexpected, outlying observations that might be problematic with a parametric approach.

Nonparametric methods are intuitive and are simple to carry out by hand, for small samples at least.

Nonparametric methods are often useful in the analysis of ordered categorical data in which assignation of scores to individual categories may be inappropriate. For example, non-parametric methods can be used to analyse alcohol consumption directly using the categories never, a few times per year, monthly, weekly, a few times per week, daily and a few times per day. In contrast, parametric methods require scores (i.e. 1–7) to be assigned to each category, with the implicit assumption that the effect of moving from one category to the next is fixed.

Disadvantages of nonparametric methods

Nonparametric methods may lack power as compared with more traditional approaches. This is a particular concern if the sample size is small or if the assumptions for the corresponding parametric method (e.g. Normality of the data) hold.

Nonparametric methods are geared toward hypothesis testing rather than estimation of effects. It is often possible to obtain nonparametric estimates and associated confidence intervals, but this is not generally straightforward.

Tied values can be problematic when these are common, and adjustments to the test statistic may be necessary.
 
Physics news on Phys.org
Sorry, what is your question here?
 
My question is

Is it possible to illustrate the underlined points with examples, so I can get a clear understanding
 
Can you focus on the one most important point?

What you are currently asking would be more along the lines of a textbook rather than an internet post. I can help with any of the points except the last, but not with all of them together. It is too much.
 
CuriousArv said:
My question is

Is it possible to illustrate the underlined points with examples, so I can get a clear understanding

I'd google for nonparametric tests of statistics. Parametric tests assume that the distribution from which the sample is taken is known. Normal, binomial, Poisson, whateve. Non-parametric tests make no such assumptions.
 
hello

okay will make it more narrower for now.

Nonparametric methods are geared toward hypothesis testing rather than estimation of effects. ~ okay, i don't follow this one.

Secondly whenever people write: Parametric tests assume that the distribution from which the sample is taken is known. Non-parametric does not, some other people write that the form of the functional is not known. Are these two different things? If the distribution is unknown, i understand that to mean that if one collected a lot of data during sampling, the residual around the line of best fit for each point in the line is not necessarily normally distributed. Is that correct?
 
if people are uncomfortable explaining because I should do it by myself, please let me know so I can close this thread. For people doing research who need to tie together knowledge from multiple fields and the resulting drain -> collab and asking questions on forums -> allowable? protocol -> exhaustion thinking about protocols...anyway..
 
CuriousArv said:
Nonparametric methods are geared toward hypothesis testing rather than estimation of effects. ~ okay, i don't follow this one.
So for this one, suppose that you have a typical placebo controlled randomized trial testing a weight loss treatment. You would certainly measure the subject's weight change, but you might also have the subjects report their perceived energy level on a 5-point scale like "lethargic" to "tired" to "normal" to "energized" to "hyperactive".

So you would want to use parametric methods on the weight. That would allow you to determine whether the treatment and control groups lost different amounts of weight (hypothesis test) and if so then how many more kilograms of weight were lost on average (effect size).

But for energy level you would only use non-parametric methods. You could determine if the treatment and control groups had different levels of energy (hypothesis test) But if they did then you would not be able to determine how much more energy. After all, on this scale what would effect size even mean? Like for example what would it mean to have 1.2 more energy.
 
Last edited:
CuriousArv said:
if people are uncomfortable explaining because I should do it by myself, please let me know
No problem. I just couldn't tackle all of the topics at once.
 
  • #10
I have not seen a non-parametric method that is similar to regression, but there may be some. It may help you to see an example of a non-parametric methods. There are probably many examples on the internet.

A typical non-parametric test would be to test if the mean of distribution A is greater than the mean of distribution B with some confidence (say 95%). You can put the the numbers from a sample of A and a sample of B in order from smallest to largest, like: a1 < a2 < b1 < a3 < b2 < b3 < a4 < a5 < b4 < b5. The "rank ordering" of the numbers can be used in a statistical test. The statistical test does not need to know the distributions A and B. It is a non-parametric test.
 

Similar threads

  • · Replies 3 ·
Replies
3
Views
3K
Replies
3
Views
3K
  • · Replies 23 ·
Replies
23
Views
4K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
Replies
10
Views
6K