Performing Detection with IID RV: Unknown PDF & Neamen Pearson Test Efficiency

  • Context: Graduate 
  • Thread starter Thread starter sibtain125
  • Start date Start date
  • Tags Tags
    Pdf
Click For Summary

Discussion Overview

The discussion revolves around the application of the Neyman-Pearson test in the context of signal detection when the distribution of the signal is unknown, but it is known to be an independent and identically distributed (IID) random variable with zero mean and fixed variance. Participants explore whether the test can still be performed under these conditions and the implications for the resulting probability density function (PDF) when Gaussian noise is present.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested
  • Mathematical reasoning

Main Points Raised

  • One participant questions whether the Neyman-Pearson test can be applied when the distribution of the signal is unknown, suggesting that the test might still be valid under certain conditions.
  • Another participant notes that a Gaussian distribution could apply if discussing the sum or average of a large number of signals, but raises concerns about hypotheses related to a single signal.
  • A participant clarifies that with a large number of samples, the scenario aligns with standard detection problems in signal processing, where the presence or absence of a signal is tested.
  • It is mentioned that to use the Neyman-Pearson test, one must compute the likelihood of observed values based on chosen statistics, which requires assumptions about the underlying distribution of the signal.
  • A later reply expresses uncertainty about the resulting PDF when adding an IID random variable with an unknown distribution to a Gaussian PDF, questioning whether the resulting distribution remains Gaussian.

Areas of Agreement / Disagreement

Participants express differing views on the applicability of the Neyman-Pearson test under the given conditions, with some suggesting it may be feasible while others highlight the challenges posed by the unknown distribution of the signal. The discussion remains unresolved regarding the nature of the resulting PDF when combining distributions.

Contextual Notes

Limitations include the dependence on assumptions about the distribution of the IID random variable and the implications of using different statistics for likelihood computation. The discussion does not resolve the mathematical steps involved in determining the resulting PDF.

sibtain125
Messages
3
Reaction score
0
Hi all


1) When we are performing detection , and we have received this y(n)=x(n)+z(n) for n=0,1,2,3..., where z is gaussian noise, but about x(n) we don't know its distribution , all we know that it is I.I.D. random variable with zero mean and fxed given variance. Now my question is can we still perform the Neamen Pearson test . p(y;H1)/p(y;H0)>gamma in the same manner we do when x distribution is completely known.

2) If the answer to the above question is yes then will the pdf of p(y;H1) be gaussian with mean=0 and variance = (noise variance + signal variance).

3) Can you please refer me to useful texts where i can find how COST functions are modeled for signal detection systems.

regards
 
Physics news on Phys.org
What exactly are your hypotheses?

A Gaussian would apply if you are talking about the distribution of the sum or average of a large number of signals.

If your hypotheses are about a single signal , such as H0: y[3] = 5 , I think you are out of luck.
 
hi well i have say N number of samples and it can be assumed to be large. actually its a standard detection problem in signal processing , when you are looking for the presence or absence of a signal . H0 means that the signal is not there and the variance of data is say sigma0 and under H1 when the signal is present then the variance of the received data is sigma1.
Inshort yes , the signals come from the distributions of large no. of signals.
 
sibtain125 said:
H0 means that the signal is not there and the variance of data is say sigma0 and under H1 when the signal is present then the variance of the received data is sigma1

To use Neyman-Peason you must pick some statistic or statistics and compute the likelihood of their observed value given each of the sigma's. If your idea is to use the individual values of the observed signals y[0], y[1],... as the statistics, you cannot compute the liklihood of this vector of values without assuming some specific probability distribution for the x. If you use a statistic involving the sum of the y, you can approximate this distribution as normal. For example, the mean, y_bar, of a sample of n of the y is approximately normally distributed.
 
Thanks Stephen, that solves the problem ,

anyway it means that we don't know what happens when we add IID RV (say: mean=0, var=1, unknown pdf) to a gaussian pdf (mean=0, var=1). should the resultng pdf remain a gaussian with var=2. thanks again
 

Similar threads

  • · Replies 12 ·
Replies
12
Views
5K
  • · Replies 11 ·
Replies
11
Views
2K
Replies
1
Views
4K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 20 ·
Replies
20
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 19 ·
Replies
19
Views
3K