>47% false positive rate on COVID-19 test?

Click For Summary

Discussion Overview

The discussion revolves around the false positive rate of COVID-19 tests, particularly focusing on the implications of a reported 47% false positive rate in asymptomatic individuals who have been in contact with confirmed cases. Participants explore the significance of this rate in the context of testing strategies, public health implications, and the reliability of various testing methods.

Discussion Character

  • Debate/contested
  • Exploratory
  • Technical explanation
  • Conceptual clarification

Main Points Raised

  • Some participants highlight a study suggesting that the false positive rate for asymptomatic close contacts could be as high as 80.33%, raising concerns about the accuracy of active screening methods.
  • Others mention specific cases, such as a passenger from the Westerdam cruise ship, who tested positive and then negative, questioning whether this indicates a false positive or a quick recovery.
  • There are discussions about the role of full genome sequencing in confirming positive results and potentially ruling out false positives, although it is noted that this is not routinely done.
  • Bayes' theorem is referenced, indicating that a low incidence of the disease can lead to a high false positive rate, which some participants argue is crucial to consider when interpreting test results.
  • Some participants express concern that widespread testing without understanding the false positive implications could lead to public complacency regarding COVID-19 symptoms and safety measures.
  • There is a mention of the potential for false negatives in asymptomatic individuals, complicating the interpretation of testing results and public health recommendations.
  • Several participants express confusion or skepticism about the implications of the reported false positive rates, with some finding the information alarming and others suggesting it could be misinterpreted.

Areas of Agreement / Disagreement

Participants do not reach a consensus on the implications of the false positive rate, with multiple competing views on its significance and the reliability of testing methods. There is a general acknowledgment of the complexities involved in interpreting test results, particularly in asymptomatic populations.

Contextual Notes

Limitations in the discussion include the dependence on the prevalence of the disease in the population, the variability in testing methods, and the potential for misinterpretation of statistical data regarding false positives and negatives.

BWV
Messages
1,665
Reaction score
2,009
TL;DR
>47% false positive rate on COVID-19 test?
interesting:

https://www.ncbi.nlm.nih.gov/pubmed...aA-8ThVONEMGeGhecOnjMJtIblbClp8ufahx71HOFSWdg

Objective: As the prevention and control of COVID-19continues to advance, the active nucleic acid test screening in the close contacts of the patients has been carrying out in many parts of China. However, the false-positive rate of positive results in the screening has not been reported up to now. But to clearify the false-positive rate during screening is important in COVID-19 control and prevention. Methods:Point values and reasonable ranges of the indicators which impact the false-positive rate of positive results were estimated based on the information available to us at present. The false-positive rate of positive results in the active screening was deduced, and univariate and multivariate-probabilistic sensitivity analyses were performed to understand the robustness of the findings. Results: When the infection rate of the close contacts and the sensitivity and specificity of reported results were taken as the point estimates, the positive predictive value of the active screening was only 19.67%, in contrast, the false-positive rate of positive results was 80.33%. The multivariate-probabilistic sensitivity analysis results supported the base-case findings, with a 75% probability for the false-positive rate of positive results over 47%. Conclusions: In the close contacts of COVID-19 patients, nearly half or even more of the 'asymptomatic infected individuals' reported in the active nucleic acid test screening might be false positives.child that tested positive in LA now believed to be a false positive:

https://losangeles.cbslocal.com/2020/03/16/coronavirus-child-testing-negative-false-positive/
 
  • Like
Likes   Reactions: atyy
Biology news on Phys.org
The Westerdam passenger who initially tested positive after disembarkation later tested negative. Either a quick recovery or a false positive.
https://www.ktoo.org/2020/03/11/cit...uise-ship-season-makes-its-way-toward-juneau/

There are also reports that the problem with some of the first CDC test kits that led to the shortage of tests in the USA were due to false positive problems
https://www.propublica.org/article/...te-time-double-testing-some-coronavirus-cases

There are some labs that have done a full sequence in addition to the PCR test. If you do a full sequence, you can essentially rule out false positives. This article mentions two labs that do full sequences in addition to the PCR, but my guess is that this is not routinely done, and the labs do the full sequence for other reasons.
https://www.the-scientist.com/news-...-and-whats-next-in-covid-19-diagnostics-67210

- "Yvonne Doyle, the medical director and the director of health protection for Public Health England, tells The Scientist in an email that once a sample is received by a laboratory, it takes 24–48 hours to get a result. Commenting on the test’s accuracy, she says all the positive results to date in the United Kingdom, a total of 36 so far, have been confirmed with whole genome sequencing of the virus isolated from patient samples, and “the analytical sensitivity of the tests in use is very high.”"

- "The laboratory at Westmead Hospital also does a complete sequencing of every virus sample to look for possible new strains of SARS-CoV-2 and has shared some of those sequences in the international Global Initiative on Sharing All Influenza Data (GISAID) database for other researchers to study. The staff also cultures the virus and images it using electron microscopy. “That’s not really a diagnostic test, but gives you some confirmation of what you’re seeing in the laboratory,” Dwyer says.

He adds that, so far, there’s no suggestion of false positive findings, because every positive test has been confirmed with whole genome sequencing, viral culture, or electron microscopy. As for false negatives, he adds, it would be hard to know if any infected patients were mistakenly given the all-clear."
 
  • Like
Likes   Reactions: sysprog and BWV
Bayes theorem says that you will get a high false positive rate whenever the actual incidence is very low.
 
  • Like
Likes   Reactions: FactChecker, DaveE, sysprog and 2 others
BTW, the link to the full article didn't work for me, but if I understand the abstract correctly, the 47% false positive is only for screening asymptomatic close contacts. It is probably related to the calculation @Vanadium 50 did in https://www.physicsforums.com/threads/wuhan-coronavirus-containment-efforts.983707/post-6310535 (post #994)

This may be one of the reasons that (as I understand it) there is presently no recommendation to test asymptomatic people.

The other reason for not testing asymptomatic people is a kind of "false negative", in which a person has low viral load early in the incubation period, so the test is in some sense correctly negative. In another sense, of course, it is false negative since the person has been infected, so it may give people who have been infected a false sense of security such that they don't get tested when the viral load has increased after the incubation period and they have symptoms and would test positive.
 
Last edited:
  • Like
Likes   Reactions: Ygggdrasil and sysprog
i can't get the full link to work either and if I could, it is in Chinese
 
BWV said:
i can't get the full link to work either and if I could, it is in Chinese
What, you can't read and understand Chinese? Well, ok. me neither. 😌
 
  • Like
Likes   Reactions: BWV
Don't forget that you have to factor in the prevalence of the disease in the population, if known, otherwise you get a very pessimistic answer.

Cheers
 
As another non-medical person, what I get from the Abstract is that:
Of those exposed to an an infected person, somewhere between 47% and 80% picked up enough of the virus to be detected but did not get sick.

Sounds encouraging to me!
 
  • #10
Phil Core said:
I do not have a hard science background. Truth , I pretend I know stuff.

However,

If I understand this correctly - If you were around a sick person - in 47% of the cases - if tested - it would say you have the virus when you do not.

https://pubmed.ncbi.nlm.nih.gov/321...D3jt_Hjf2ZKysmDcXMU5LgVgNPcqNAtb9EzcQBKMtCIoI

This is mind blowing. If true - everyone should know about this.

Yes, that is what I understood too. @Vanadium 50 has pointed out that this may simply be the well understood phenomenon that if a condition is rare, then the test must be very specific to avoid a useless or misleading results.
 
  • #11
Veneto seems to be using tests for screening. Is it unknowingly picking out lots of false positives? Is there a danger to false positives? The next time they get symptoms, they may think it is not Covid-19, since they had it already and should have antibodies against it. So if they then assume it is just a flu they may let their guard down.
https://www.theguardian.com/world/2...ss-tests-in-italian-town-have-halted-covid-19
https://www.theguardian.com/comment...ed-coronavirus-mass-testing-covid-19-italy-vo
https://www.voanews.com/science-hea...talys-veneto-region-test-everyone-coronavirus

A company in Iceland is doing something similar, but 0.86% of random samples seems very high (about the same as Wuhan!), so it is either massively flawed or the samples are not representative of the general population (maybe they only tested the symptomatic subset)
https://cleantechnica.com/2020/03/21/iceland-is-doing-science-50-of-people-with-covid-19-not-showing-symptoms-50-have-very-moderate-cold-symptoms/

For comparison, I expect that if one tests symptomatics in a place that is not an epicenter, the positive tests should be about 1 in 200 to 1 in 1000, going by the example of the fever clinics in Guangdong.
https://www.who.int/docs/default-so...na-joint-mission-on-covid-19-final-report.pdf
"Within the fever clinicsin Guangdong, the percentageof samples that tested positive for the COVID-19 virus has decreased over time froma peak of 0.47%positive on 30 January to 0.02% on 16 February. Overall in Guangdong, 0.14% of approximately 320,000 fever clinic screenings were positive for COVID-19."

Incidentally, while South Korea does test a lot, from what I've read they do not test the general population. At the drive-through centers, one fills in a form first, and one is tested only if one is eligible (presumably only if one has symptoms or is at risk perhaps as a close contact), but I'm not sure exactly what criteria they use to determine eligibility.
 
Last edited:
  • #12
So, given that false-positives would be included in the infection statistics, did the effective mortality rate just double ?
 
  • #13
hmmm27 said:
So, given that false-positives would be included in the infection statistics, did the effective mortality rate just double ?
With a high rate of false positives, I doubt that they would rely on only one such test.
 
  • #14
FactChecker said:
With a high rate of false positives, I doubt that they would rely on only one such test.
I just read about the f.p's today, but they've been giving stats for quite a while.
 
  • #15
hmmm27 said:
I just read about the f.p's today, but they've been giving stats for quite a while.
I mean that for an individual case that gives a positive result, I think they would give that person a repeat test or two. The resulting false-positive rate of multiple tests may be fine.
 

Similar threads

  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 12 ·
Replies
12
Views
3K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 21 ·
Replies
21
Views
4K
  • · Replies 74 ·
3
Replies
74
Views
12K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 1 ·
Replies
1
Views
10K