Re: Why would AI want to be friendly?

From: Eugene Leitl (eugene.leitl@lrz.uni-muenchen.de)
Date: Fri Sep 29 2000 - 05:03:44 MDT


J. R. Molloy writes:

> That's because you are an intelligent entity. The AI, in contrast, must conform
> to the program that coders give it. <grrrin>

Such as the atoms in your body must conform to the natural laws
governing their behaviour. Or as the neurons in a biologically
realistic (such as lobster gastric ganglion) simulation produce their
spikes according to the program codifying their behaviour. Or as an
NP-complete problem of a nontrivial size is being solved by a computer
program.

These are all true statements, but they're also rather irrelevant,
because they do not impose any noticeable constraints on system
state. In all these cases, you can't prove that system A in state B
reaches state C after N steps, without traversing every single state
leading from B to C.

Because behaviour is phenotype of above state changes over time, the
problem of predicting behaviour with absolute certainty is impossible
for a class of observers less than omniscient. All assuming, of
course, that you can cleanly classify all behaviour into "desireable"
and "undesireable" bins.



This archive was generated by hypermail 2b29 : Mon Oct 02 2000 - 17:39:24 MDT