I don't understand why you think AIs would have "interests", or develop
instincts for self-preservation. In humans, those emotions are the
result of millions of years of evolution. Selfishness is natural to
humans, not natural to minds in general. Complex functional adaptations
do not simply materialize in source code, any more than three-course
meals grow on trees.
email@example.com Eliezer S. Yudkowsky http://pobox.com/~sentience/tmol-faq/meaningoflife.html Running on BeOS Typing in Dvorak Programming with PatternsVoting for Libertarians Heading for Singularity There Is A Better Way