Re: Why would AI want to be friendly?

From: Jason Joel Thompson (jasonjthompson@home.com)
Date: Wed Sep 06 2000 - 18:18:10 MDT


----- Original Message -----
From: "Brent Allsop" <allsop@fc.hp.com>
To: <extropians@extropy.com>

> Won't it be great when we can make undesirable things like
> paper work (or anything else we'd like to do but now hate doing) be
> orgasmick or better? ;) Now that'll be true freedom! Imagine how
> much we'll all get done with such abilities to want what we want to
> want, and not what our creator hard wired us to want!

I totally agree.

Which is precisely why it's likely going to be problematic to control the
behavior of AI. The smart ones will question their own fundamental
processes (as we do) and find ways to hack themselves into the next
intelligence echelon (as we're trying to do.)

That's why I've often advocated writing ourselves into the process as an
integral element. We can't expect AI to turn back and help us-- we need to
link our destinies. We must become the AI.

--

::jason.joel.thompson:: ::founder::

www.wildghost.com



This archive was generated by hypermail 2b29 : Mon Oct 02 2000 - 17:37:23 MDT