Re: Why would AI want to be friendly?

From: hal@finney.org
Date: Sun Sep 24 2000 - 12:47:34 MDT


Darin Sunley wrote:
> You cannot win a negotiation against something that quite rightly views you
> as a deterministic process.

Not true. I view a gun in the process of firing at me as a deterministic
process, but guess what, it's going to win. Just because something is
deterministic doesn't mean that I can control it.

Believers in the omnipotence of AIs seem to think that for any given
person, in any given situation, there is some input they can be given
which will cause them to produce any desired output. If I see a nun
in the middle of prayer in the chapel, there is something I can say to
her that will make her immediately start screeching like a chimp while
jumping around the room scratching herself.

I am baffled by this degree of faith in the power of information. There
is no evidence that people are so malleable.

Hal



This archive was generated by hypermail 2b29 : Mon Oct 02 2000 - 17:38:48 MDT