Re: Singularity: AI Morality

Dan Clemmensen (Dan@Clemmensen.ShireNet.com)
Fri, 11 Dec 1998 19:01:00 -0500

Samael wrote:
>
> But why would it _want_ to do anything?
>
> What's to stop it reaching the conclusion 'Life is pointless. There is no
> meaning anywhere' and just turning itself off?
>
Nothing stops any particular AI from deciding to do this. However, this doesn't stop the singularity unless it happens to every AI. The singularity only takes one AI that decides to extend itself rather than terminating.

If you are counting on AI self-termination to stop the Singularity, you'll have to explain why affects every single AI.