Is a bug in FMRI software causing decades of brain research to be invalidated?

  • Context: Medical 
  • Thread starter Thread starter gva
  • Start date Start date
  • Tags Tags
    Bug
Click For Summary

Discussion Overview

The discussion revolves around the potential implications of a bug in fMRI software that may affect the validity of decades of brain research. Participants explore the reliability of fMRI as a research technique, the nature of false positives, and the broader context of brain mapping methodologies.

Discussion Character

  • Debate/contested
  • Exploratory
  • Technical explanation

Main Points Raised

  • Some participants express skepticism about the claim that 15 years of research could be invalidated, suggesting that the reality is likely more nuanced than presented.
  • Concerns are raised regarding the high false positive rates in fMRI studies, with examples cited to illustrate the unreliability of the technique.
  • One participant notes that while the principle of brain mapping may be sound, existing maps could be noisier than previously thought due to software issues.
  • Another participant argues that the consistency in existing fMRI literature suggests that a software glitch is unlikely to significantly undermine the validity of a large body of research.
  • There is acknowledgment that understanding brain function is complex and that better measurement tools are needed, as highlighted by initiatives like the BRAIN initiative.

Areas of Agreement / Disagreement

Participants do not reach a consensus; there are competing views on the significance of the software bug and its potential impact on existing research. Some express concern over the implications, while others downplay the severity of the issue.

Contextual Notes

Participants note limitations in the reliability of fMRI as a measure of brain activity, including its indirect nature and the challenges in correlating observable data with neuronal activity. There are also references to the need for improved software standards and measurement techniques.

Biology news on Phys.org
My .02 after reading -

That image processing software has bugs should not be surprising to anyone who has visibility into the realities of complex software development and maintenance.

The speculation that 15 years of research is potentially invalid is just that - speculation. My own speculation is that the reality is much more grey than black and white.

The false positive rate seems pretty high to me, so to the extent that the specific detection mechanism cited is central to a previous conclusion, I would think that conclusion is at risk of being not-duplicatable or perhaps weaker than initially thought. My guess is that the principle of brain mapping is sound, the existing maps are probably noisier than they will become as mapping techniques continue to improve.

I am certain that the last bug in imaging software has not been found, its a journey.
 
It is certainly believable. fMRI studies have been notoriously unreliable as a research technique and subject to many false positive. For example, to demonstrate the ease of discovering false positives, researches placed a dead salmon from the supermarket into an fMRI scanner and, using the same analysis techniques used in many published papers, found signs of activity in certain regions of the brain when showing the salmon pictures of human faces. Furthermore, fMRI is a very indirect measure of brain activity, measuring things like increased blood flow or increased metabolic activity in different areas of the brain. To what extent these observables correlate with the underlying activity of neurons is still unclear.

Here's a nice piece from a few years ago highlighting some of the issues with fMRI and other similar brain scans:
http://blogs.scientificamerican.com/guest-blog/controversial-science-of-brain-imaging/

For the above reasons, I've never put much faith in the 15 years of brain research that has been invalidated in the first place (but I'm not a neuroscientist). Understanding how the brain works is difficult, in part, because we lack good tools for measuring and monitoring brain activity. This is certainly an area where new technologies would be very helpful (the impetus for Obama's BRAIN initiative).
 
  • Like
Likes   Reactions: Fervent Freyja
I have high doubts that this is a significant issue, despite Ygggdrasil's alarmism. Don't believe that 40,000 plus research reports are going to be flushed down the drain. There's a remarkable amount of consistency in the data results in extant "resting-state" fMRI brain literature that comports with knowledge of the evolutionary and functional neuroanatomy of the brain. The likelihood that a computer glitch is going to confound BOLD signal readings in a significant portion of the 40K papers in question is vanishingly small. So I wouldn't lose sleep over it. That doesn't mean that the software doesn't need to be up to standard, though, far from it, it just means that don't be too quick to throw out the baby with the bathwater.

Ironically, part of my job as a research assistant in an AI lab this fall is going to be to do data management on the 1000's of fMRI studies out there. I'm sure the head of the lab is already aware of the media reports presented here, but I'll bring it to his attention, anyway. I'm actually going to meet up with him in a about a week and half at the IEEE WCCI in Vancouver. So I'll give you the updated report on the matter..

http://www.wcci2016.org/index.php
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
Replies
1
Views
3K
Replies
5
Views
1K
  • · Replies 14 ·
Replies
14
Views
2K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 9 ·
Replies
9
Views
3K