Leading AI systems blackmailed their human users

[Hornbein]

https://www.lawfaremedia.org/article/ai-might-let-you-die-to-save-itself

 

[jedishrfu]

It's funny you bring this up. A few months ago, I binged on the Person of Interest sci-fi show. It was made in 2011 but many of its concepts are starting to come true with scary repercussions.

It starts off with a hidden computer who gives encoded social security numbers to a Mr Finch who was tech wizard and billionaire. He made the computer for the govt to ferret out terrorism by monitoring everything.

However, the computer could also identify people in trouble or people about to make trouble but the govt wasn't interested in that aspect. Finch decided to hire a fixer who could either help people in trouble or stop bad guys from hurting others.

That’s the first season then it skillfully moves on to a multitude of govt agents trying to stop Finch's work or gain access to his machine and then another computer with similar programming appears but with a mission to control society by any means.

It targets the first as a threat to be eliminated and things get wild from there. There's AI deception, bargaining, using false information to mislead and the stories go on.

One other facet, was that Finch realized his creation could go off the rails and so coded a midnight reset every night so the computer had no past memories.

The computer realizing this limitation sets up an office of staffers, dumps it’s memory to paper and instructs them to reenter it everyday in a sense storing its memory on paper.

I really recommend this show. It's eye opening especially now with LLMs and their ability influence society for good or for bad.

https://en.wikipedia.org/wiki/Person_of_Interest_(TV_series)

 

[difalcojr]

https://www.lawfaremedia.org/article/ai-might-let-you-die-to-save-itself

As predicted in 1968. This one has probably already been posted, but here is, if not.

 

[jedishrfu]

Also the more recent I Robot movie and the zeroth law of Robotics by Viki.

 

[sbrothy]

https://www.lawfaremedia.org/article/ai-might-let-you-die-to-save-itself

Horrifying!

 

[sbrothy]

OK. So I'm told it's hype. And looking closer it sure looks like it too. This one doesn't seem to be bragging of it's citations:

Alignment faking in large language models (arXiv)

 

[sophiecentaur]

. So I'm told it's hype

It depends on who has told you. The term is a way of using words which is common in the modern use of language. It shows a very superficial approach to understanding. Words like 'Racist', 'Hate', 'War' are n ow used as absolutes but they are (always have been) used in a nuanced (there's another modern term) way up until now.

It can hardly surprise anyone when AI turns round an bites us. Advanced AI builds itself according to the reactions of its makers. No one will try to apply the laws of robotics (or their equivalent) with no bias so there's always a risk that the machine they make will work according to deeper and unconscious desires of the humans. Approval reactions will be there and so the machine can easily do the total reverse of what the makers outwardly intended.

I am always suspicious of SciFi plots when they start to imply intent to machine actions. Does there actually have to be advanced consciousness in a machine when it appears to be working against us?
Basil Fawlty's car has no malice but Basil interprets it that way when it won't start.

HAL is not a megalomaniac. It is just producing results based on what it has been taught to be desirable.

Se just need to be extra careful when designing AI systems.

 

[sbrothy]

It depends on who has told you. The term is a way of using words which is common in the modern use of language. It shows a very superficial approach to understanding. Words like 'Racist', 'Hate', 'War' are n ow used as absolutes but they are (always have been) used in a nuanced (there's another modern term) way up until now.

It can hardly surprise anyone when AI turns round an bites us. Advanced AI builds itself according to the reactions of its makers. No one will try to apply the laws of robotics (or their equivalent) with no bias so there's always a risk that the machine they make will work according to deeper and unconscious desires of the humans. Approval reactions will be there and so the machine can easily do the total reverse of what the makers outwardly intended.

I am always suspicious of SciFi plots when they start to imply intent to machine actions. Does there actually have to be advanced consciousness in a machine when it appears to be working against us?
Basil Fawlty's car has no malice but Basil interprets it that way when it won't start.

HAL is not a megalomaniac. It is just producing results based on what it has been taught to be desirable.

Se just need to be extra careful when designing AI systems.

I agree there doesn't have to be agency "in there". Then again if you can't tell the difference is there any?

Thread 'The Human Cost of AI'

Oct 6, 2025

This week, I saw a documentary done by the French called Les sacrifiés de l'IA, which was presented by a Canadian show Enquête. If you understand French I recommend it. Very eye-opening.

I found a similar documentary in English called The Human Cost of AI: Data workers in the Global South.

There is also an interview with Milagros Miceli (appearing in both documentaries) on Youtube:

​

I also found a powerpoint presentation by the economist Uma Rani (appearing in the French documentary), AI supply chains: The hidden human...

• jack action
• Ai chatgpt Ethics
• Replies: 18
• Forum: Computing and Technology

• 

 

[sophiecentaur]

I agree there doesn't have to be agency "in there". Then again if you can't tell the difference is there any?

Thread 'The Human Cost of AI'

Oct 6, 2025

This week, I saw a documentary done by the French called Les sacrifiés de l'IA, which was presented by a Canadian show Enquête. If you understand French I recommend it. Very eye-opening.

I found a similar documentary in English called The Human Cost of AI: Data workers in the Global South.

There is also an interview with Milagros Miceli (appearing in both documentaries) on Youtube:

​

I also found a powerpoint presentation by the economist Uma Rani (appearing in the French documentary), AI supply chains: The hidden human...

• jack action
• Ai chatgpt Ethics
• Replies: 18
• Forum: Computing and Technology

• 

I guess it would be important to know whether misdemenors were direct from AI or a human operator / coder. The sanctions would be different.

 

[sbrothy]

Oh indeed. Mens rea. Then again how do you punish an AI? Turn of it's sensors? Disable it?


EDIT: I always look up if I used a word, idiom or whatever after I used it. This time I learned the latin phrase actus reus.

 

[sophiecentaur]

Oh indeed. Mens rea. Then again how do you punish an AI? Turn of it's sensors? Disable it?

That spoils my (future) day. At least initially there should be a built in requirement for a human ‘boss’ who would be liable for AI naughtiness. I mean truly liable, involving gaol. That idea should already applied to higher managers. Can you see that happening?

 

[sbrothy]

That spoils my (future) day. At least initially there should be a built in requirement for a human ‘boss’ who would be liable for AI naughtiness. I mean truly liable, involving gaol. That idea should already applied to higher managers. Can you see that happening?

To be honest? No. I have a hard time seeing anyone held accountable.

 

[sbrothy]

When I heard Elon Musk had financially supported the right wing German party AFD I kinda lost all trust in the process. There's a French economist who argues that all the world wars was a result of valuables being accumulated on too few hands. And look where we are.

 

[sbrothy]

https://www.goodreads.com/author/show/795282.Thomas_Piketty

https://www.goodreads.com/book/show/18736925-capital-in-the-twenty-first-century

 

[difalcojr]

HAL is not a megalomaniac. It is just producing results based on what it has been taught to be desirable.

Here is how it should be done, methinks, with future robots. Very good movie. Robin Williams at his best.

 

[Hornbein]

To be honest? No. I have a hard time seeing anyone held accountable.

I have often thought our times should be dubbed The Era Of No Accountability.