Is a bug in FMRI software causing decades of brain research to be invalidated?

  • Medical
  • Thread starter gva
  • Start date
  • Tags
    Bug
In summary, the software bugs may invalidate decades of brain research. Scientists are speculating that it may not be a big deal because of the consistency of data in existing "resting-state" fMRI brain scans.
Biology news on Phys.org
  • #2
My .02 after reading -

That image processing software has bugs should not be surprising to anyone who has visibility into the realities of complex software development and maintenance.

The speculation that 15 years of research is potentially invalid is just that - speculation. My own speculation is that the reality is much more grey than black and white.

The false positive rate seems pretty high to me, so to the extent that the specific detection mechanism cited is central to a previous conclusion, I would think that conclusion is at risk of being not-duplicatable or perhaps weaker than initially thought. My guess is that the principle of brain mapping is sound, the existing maps are probably noisier than they will become as mapping techniques continue to improve.

I am certain that the last bug in imaging software has not been found, its a journey.
 
  • #3
It is certainly believable. fMRI studies have been notoriously unreliable as a research technique and subject to many false positive. For example, to demonstrate the ease of discovering false positives, researches placed a dead salmon from the supermarket into an fMRI scanner and, using the same analysis techniques used in many published papers, found signs of activity in certain regions of the brain when showing the salmon pictures of human faces. Furthermore, fMRI is a very indirect measure of brain activity, measuring things like increased blood flow or increased metabolic activity in different areas of the brain. To what extent these observables correlate with the underlying activity of neurons is still unclear.

Here's a nice piece from a few years ago highlighting some of the issues with fMRI and other similar brain scans:
http://blogs.scientificamerican.com/guest-blog/controversial-science-of-brain-imaging/

For the above reasons, I've never put much faith in the 15 years of brain research that has been invalidated in the first place (but I'm not a neuroscientist). Understanding how the brain works is difficult, in part, because we lack good tools for measuring and monitoring brain activity. This is certainly an area where new technologies would be very helpful (the impetus for Obama's BRAIN initiative).
 
  • Like
Likes Fervent Freyja
  • #4
I have high doubts that this is a significant issue, despite Ygggdrasil's alarmism. Don't believe that 40,000 plus research reports are going to be flushed down the drain. There's a remarkable amount of consistency in the data results in extant "resting-state" fMRI brain literature that comports with knowledge of the evolutionary and functional neuroanatomy of the brain. The likelihood that a computer glitch is going to confound BOLD signal readings in a significant portion of the 40K papers in question is vanishingly small. So I wouldn't lose sleep over it. That doesn't mean that the software doesn't need to be up to standard, though, far from it, it just means that don't be too quick to throw out the baby with the bathwater.

Ironically, part of my job as a research assistant in an AI lab this fall is going to be to do data management on the 1000's of fMRI studies out there. I'm sure the head of the lab is already aware of the media reports presented here, but I'll bring it to his attention, anyway. I'm actually going to meet up with him in a about a week and half at the IEEE WCCI in Vancouver. So I'll give you the updated report on the matter..

http://www.wcci2016.org/index.php
 

1. What is an FMRI software bug?

An FMRI software bug is a coding error or flaw in the software used to analyze and interpret functional magnetic resonance imaging (FMRI) data. This bug can lead to incorrect results and affect the validity of research findings.

2. How common are FMRI software bugs?

FMRI software bugs are relatively common, with studies estimating that up to 20% of published FMRI studies could contain significant software errors. These bugs can range from minor errors to more serious flaws that can completely invalidate the study results.

3. What are the consequences of an FMRI software bug?

The consequences of an FMRI software bug can vary depending on the severity of the bug. In some cases, it may result in minor errors or discrepancies in the study results. However, more serious bugs can lead to completely incorrect conclusions and undermine the credibility of the entire study.

4. How can FMRI software bugs be prevented?

To prevent FMRI software bugs, it is important for researchers to thoroughly test and validate the software before using it for data analysis. This includes conducting quality control checks and replicating results with different software programs. Additionally, using open-source software and making the code available for review by other researchers can also help identify and fix potential bugs.

5. What should be done if an FMRI software bug is discovered?

If an FMRI software bug is discovered, it is important for researchers to be transparent and report the bug to the scientific community. This may involve publishing a correction or retraction of the study, depending on the severity of the bug and its impact on the results. It is also important to work with the software developers to address and fix the bug to prevent it from affecting future studies.

Similar threads

  • Biology and Medical
Replies
2
Views
3K
  • Computing and Technology
Replies
2
Views
1K
  • Biology and Medical
Replies
5
Views
2K
  • Biology and Medical
Replies
3
Views
861
  • Biology and Medical
Replies
2
Views
1K
Replies
6
Views
2K
Replies
1
Views
797
  • Programming and Computer Science
Replies
14
Views
1K
Replies
2
Views
2K
  • Biology and Medical
Replies
16
Views
3K
Back
Top