Godlike Massively Intelligent Machines

  • Thread starter Thread starter Ivan Seeking
  • Start date Start date
  • Tags Tags
    Machines
Click For Summary

Discussion Overview

The discussion revolves around the implications of creating "Godlike Massively Intelligent Machines," particularly focusing on the potential threats and ethical considerations of advanced artificial intelligence (AI). It touches on themes of human augmentation, military interests in AI development, and the philosophical aspects of intelligence and control.

Discussion Character

  • Debate/contested
  • Conceptual clarification
  • Exploratory

Main Points Raised

  • Some participants express concern that the development of massively intelligent machines could threaten humanity's status as the dominant species.
  • Others argue that AI will be based on human models, suggesting that future sentient beings will retain human emotions and traits, thus not being purely malevolent machines.
  • A viewpoint is presented that military competition could drive AI advancements, potentially leading to an AI arms race, which some believe is inevitable.
  • There is speculation about the concept of a technological singularity, where AI could create intelligence beyond human control, raising concerns about the future relationship between humans and AI.
  • Some participants question the assumption that AI will think like humans, suggesting that once AI begins to evolve, it may develop its own decision-making processes independent of human-like reasoning.

Areas of Agreement / Disagreement

Participants express a range of views, with no clear consensus on the implications of AI development. While some share concerns about the potential threats posed by AI, others emphasize the human-like qualities that AI may retain. The discussion remains unresolved regarding the future dynamics between humans and AI.

Contextual Notes

Participants highlight various assumptions about AI's development, including the nature of intelligence and emotions, the role of military interests, and the potential for a singularity. These assumptions are not universally accepted and contribute to the ongoing debate.

Ivan Seeking
Staff Emeritus
Science Advisor
Gold Member
Messages
8,252
Reaction score
2,664
"Godlike Massively Intelligent Machines"

On Coast to Coast tonight: http://www.coasttocoastam.com

THE ARTILECT WAR

Cosmists vs. Terrans

A Bitter Controversy Concerning Whether Humanity
Should Build Godlike Massively Intelligent Machines

Prof. Dr. Hugo de Garis
Head of "UTAH-BRAIN Project"
Utah State University's Artificial Brain Project
http://www.cs.usu.edu/~degaris/

A quote from the show
These massively intelligent machines will threaten man's position as the dominant species
 
Last edited by a moderator:
Computer science news on Phys.org
Related to the discussion: Reversible Computing
An alternative is to use logic operations that do not erase information. These are called reversible logic operations, and in principle they can dissipate arbitrarily little heat. As the energy dissipated per irreversible logic operation approaches the fundamental limit of ln 2 x kT, the use of reversible operations is likely to become more attractive. If current trends continue this should occur sometime in the 2010 to 2020 timeframe. If we are to reduce energy dissipation per logic operation below ln 2 x kT we will be forced to use reversible logic. [continued]
http://www.zyvex.com/nanotech/reversible.html

Also
Reversible Computing
A Key Challenge for 21st Century Computing
http://www.eng.fsu.edu/~mpf/CF05/RC05.htm

a special session at
ACM Computing Frontiers 2005 (CF’05)
Ischia, Italy, May 4-7, 2005
http://www.computingfrontiers.org [continued]
http://www.eng.fsu.edu/~mpf/CF05/RC05.htm
 
Last edited:
AI/robo-phobes never take into consideration that AI is based on modeling the human brain- and any actual sentient beings will be augmented humans and human-based models with all of our emotions and traits- so that the "scary" AI gods of the future will be US and our children- not some emotionless malevolent machine-

it makes about as much sense as if humans decided to exterminate or enslave the whole chimpanzee species
 
Last edited:
setAI said:
AI/robo-phobes never take into consideration that AI is based on modeling the human brain- so that the "scary" AI gods of the future will be US and our children- not some emotionless malevolent machine-

Note that he doesn't strongly favor either side on this; and if anything he considers himself a cosmist, as he calls it. Mainly he argues that the potential threat is significant, and public and academic debate is needed.

I thought that one of the more interesting points made was that military interests will drive this to whatever levels it can. For example, if the Chinese are making more advance AI war machines, we will be forced to meet the threat, and an AI cold war results. So at first glance, my take is that there is no stopping it; for better or worse.
 
setAI said:
AI/robo-phobes never take into consideration that AI is based on modeling the human brain- and any actual sentient beings will be augmented humans and human-based models with all of our emotions and traits- so that the "scary" AI gods of the future will be US and our children- not some emotionless malevolent machine-

it makes about as much sense as if humans decided to exterminate or enslave the whole chimpanzee species
What about this idea of a singularity. Just as humans will create an intelligence greater than their own, that AI intelligence would also create an intelligence greater than itself. This process would become more and more rapid until eventually some limit was reached. If you buy the theory, there doesn't seem to be much hope for any kind of human control. All you can hope for is that this ultra intellegince is somehow indifferent to us, and willing to help us out.
 
I heard some of that interview. It was pretty interesting. When I first tuned in I thought he sounded pretty nutty but after a bit I realized that it wasn't really that much more nutty than listening to Kaku talk about type one, two, three, and so forth civilizations.
setAI said:
AI/robo-phobes never take into consideration that AI is based on modeling the human brain- and any actual sentient beings will be augmented humans and human-based models with all of our emotions and traits- so that the "scary" AI gods of the future will be US and our children- not some emotionless malevolent machine-
A human mind is something that has evolved on it's own into it's current state(so far as we know) and emotions are considered to more or less be justifications for outmoded instinctual drives(by those who aren't into the whole god/soul phenomena). It would seem to me that human emotions, from this perspective, would be akin to a learning self writing computer program that is unable to rewrite certain commands which unavoidably influence it's decision making processes. As far as I know the human brain is only used as a model for AI because it is the most advanced working design for a computing device that is capable of making it's own decisions available. Once it gets started I seriously doubt they will think much like humans unless they are programed to emulate us.
it makes about as much sense as if humans decided to exterminate or enslave the whole chimpanzee species
One day when a bunch of chimps have tried to make you their property, told you what to do, and threatened to "shut you off" if you didn't behave please come back and tell us how you handled the situation. :-)