Binary classification: error probability minimization

Click For Summary
In binary classification, particularly in applications like radar detection and medical testing, the goal is to minimize the total probability of error, which includes both false positives and false negatives. The discussion highlights a scenario where a radar system detects a signal affected by Gaussian noise, leading to a proposed decision rule based on the observation Y. The optimal decision rule suggested is to classify the signal as present if Y is greater than A/2, aiming to minimize error. However, the challenge remains in proving that this specific rule is indeed optimal compared to other possible decision rules. The concept of total probability of error is further clarified as the sum of type I and type II error probabilities, with reference to receiver operating characteristic (ROC) curves for analysis.
Bipolarity
Messages
773
Reaction score
2
Typically in problems involving binary classification (i.e. radar detection, medical testing), one will try to find a binary classification scheme that minimizes the total probability of error.

For example, consider a radar detection system where a signal is corrupted with noise, so that if the signal is present and has value A, the radar detects Y = A + X where X is noise, and if the signal is not present, the radar detects Y = X.

Given the observation Y, one wishes to find a decision rule regarding whether or not the signal was present that will minimize the probability of error. Error occurs either as false positives (type I) or false negatives (type II).

If you know that the noise X is Gaussian with zero-mean and unit variance, one can (with some calculations) show that a good decision rule is to see whether Y<A/2 or Y>A/2 to decide whether or not the signal is present. I think most would agree that this minimizes the total probability of error. However, how would one prove this? There are, after all, an infinite set of possibilities for the decision rule. One could have some weird decision rule like:
A > |Y| > A/2 --> signal is present, otherwise signal is absent, but these would be suboptimal. How one would PROVE that the rule Y>A/2 is optimal in the sense that it minimizes error?

Thanks!

BiP
 
Physics news on Phys.org
Bipolarity said:
I think most would agree that this minimizes the total probability of error.

How do you define the "total probability of error"?

Binary detectors are often analyzed by looking at their "receiver operating characteristic" (ROC) curve.
 
The total probability of error is the sum of probabilities of type 1 and type 2 errors respectively. I am aware of the ROC curves, but that does not answer my question.
 
Hello, I'm joining this forum to ask two questions which have nagged me for some time. They both are presumed obvious, yet don't make sense to me. Nobody will explain their positions, which is...uh...aka science. I also have a thread for the other question. But this one involves probability, known as the Monty Hall Problem. Please see any number of YouTube videos on this for an explanation, I'll leave it to them to explain it. I question the predicate of all those who answer this...
There is a nice little variation of the problem. The host says, after you have chosen the door, that you can change your guess, but to sweeten the deal, he says you can choose the two other doors, if you wish. This proposition is a no brainer, however before you are quick enough to accept it, the host opens one of the two doors and it is empty. In this version you really want to change your pick, but at the same time ask yourself is the host impartial and does that change anything. The host...
I'm taking a look at intuitionistic propositional logic (IPL). Basically it exclude Double Negation Elimination (DNE) from the set of axiom schemas replacing it with Ex falso quodlibet: ⊥ → p for any proposition p (including both atomic and composite propositions). In IPL, for instance, the Law of Excluded Middle (LEM) p ∨ ¬p is no longer a theorem. My question: aside from the logic formal perspective, is IPL supposed to model/address some specific "kind of world" ? Thanks.

Similar threads

Replies
8
Views
2K
Replies
18
Views
3K
Replies
1
Views
2K
Replies
4
Views
2K
Replies
14
Views
4K
Replies
2
Views
2K
Replies
4
Views
1K