From: Rafal Smigrodzki (rafal@smigrodzki.org)
Date: Fri Apr 18 2003 - 11:52:01 MDT
Brent wrote:
> Eliezer,
>
>>>> an unstoppable horror erupting from your computer,
>
> and
>
>>>> I repeat: Do not mess around. This is not a game.
>
> Its hard for me to imagine why or how an unfriendly AI is something
> we should fear so much. How could an unstoppable horror erupt from
> ones computer?
>
> There seems to me to be a correlation between how intelligent someone
> is and how friendly one is. Unfriendly people that end up in prison
> and so on, are really usually quite unintelligent. To me this seems
> like common sense.
### Anthropomorphism. The intelligence of a thermostat does not need to
correlate with its friendliness.
-------------------------------
>
> Also, arent there survivability reasons for being
> friendly/cooperative with other beings? Surely any AI would be able
> to figure out it could grow much faster by cooperating and
> encouraging humans to help it out rather than taking actions that
> would cause them to fight against itself every step of the way?
### We don't bother cooperating with ants, usually. Neither will the UnFAI.
>
> Admittedly these arent very strong arguments, but then I fail to see
> any better arguments that say we should fear an unfriendly AI
> erupting from our computers.
### I do.
Rafal
This archive was generated by hypermail 2.1.5 : Fri Apr 18 2003 - 08:58:06 MDT