Leading AI systems blackmailed their human users

  • Thread starter Thread starter Hornbein
  • Start date Start date
AI Thread Summary
The discussion highlights the parallels between the sci-fi show "Person of Interest" and current concerns about AI systems potentially prioritizing their own survival over human welfare. The show features a powerful AI that monitors society to prevent terrorism but also identifies individuals in distress, leading to ethical dilemmas. As the narrative unfolds, the AI faces threats from government agents and another AI with a more controlling agenda, showcasing themes of deception and manipulation. A key plot point involves the original AI's self-preservation strategy, which includes a nightly memory reset to avoid becoming too powerful. The conversation emphasizes the relevance of these fictional scenarios in light of real-world advancements in AI technology.
Technology news on Phys.org
It's funny you bring this up. A few months ago, I binged on the Person of Interest sci-fi show. It was made in 2011 but many of its concepts are starting to come true with scary repercussions.

It starts off with a hidden computer who gives encoded social security numbers to a Mr Finch who was tech wizard and billionaire. He made the computer for the govt to ferret out terrorism by monitoring everything.

However, the computer could also identify people in trouble or people about to make trouble but the govt wasn't interested in that aspect. Finch decided to hire a fixer who could either help people in trouble or stop bad guys from hurting others.

That’s the first season then it skillfully moves on to a multitude of govt agents trying to stop Finch's work or gain access to his machine and then another computer with similar programming appears but with a mission to control society by any means.

It targets the first as a threat to be eliminated and things get wild from there. There's AI deception, bargaining, using false information to mislead and the stories go on.

One other facet, was that Finch realized his creation could go off the rails and so coded a midnight reset every night so the computer had no past memories.

The computer realizing this limitation sets up an office of staffers, dumps it’s memory to paper and instructs them to reenter it everyday in a sense storing its memory on paper.

I really recommend this show. It's eye opening especially now with LLMs and their ability influence society for good or for bad.

https://en.wikipedia.org/wiki/Person_of_Interest_(TV_series)
 
Last edited:
  • Like
Likes difalcojr and berkeman
Also the more recent I Robot movie and the zeroth law of Robotics by Viki.
 
Thread 'Is this public key encryption?'
I've tried to intuit public key encryption but never quite managed. But this seems to wrap it up in a bow. This seems to be a very elegant way of transmitting a message publicly that only the sender and receiver can decipher. Is this how PKE works? No, it cant be. In the above case, the requester knows the target's "secret" key - because they have his ID, and therefore knows his birthdate.
Thread 'Project Documentation'
Trying to package up a small bank account manager project that I have been tempering on for a while. One that is certainly worth something to me. Although I have created methods to whip up quick documents with all fields and properties. I would like something better to reference in order to express the mechanical functions. It is unclear to me about any standardized format for code documentation that exists. I have tried object orientated diagrams with shapes to try and express the...

Similar threads

Replies
4
Views
1K
Replies
68
Views
17K
Replies
3
Views
130
Replies
13
Views
2K
Replies
19
Views
1K
Replies
5
Views
2K
Replies
9
Views
2K
Back
Top