Re: Singularity: AI Morality

John Clark (jonkc@worldnet.att.net)
Tue, 8 Dec 1998 01:30:22 -0500

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Nick Bostrom <bostrom@ndirect.co.uk>

>building smart safeguards into the moral system. For
>example, rather than rigidly prescribing a certain treatment for
>humans, we could add a clause allowing for democratic decisions by
>humans or human descendants to overrule other laws. I bet you could
>think of some good safety-measures if you put your mind to it.

I don't think security is possible by hardwiring certain actions into an AI and any attempt to do so would only increase the possibility of it becoming insane. Security is hard enough to maintain when you only have to worry about criminals of average or more likely below average brain power, you can't outsmart somebody vastly more intelligent than you are. There are no guarantees but or best bet is to do the best we can to make an AI that is sane and then just hope it likes us, who knows it might work.

John K Clark jonkc@att.net

-----BEGIN PGP SIGNATURE-----
Version: PGP for Personal Privacy 5.5.5

iQA/AwUBNmzHft+WG5eri0QzEQLxAQCfSZv9/FwPpeyD2qm0LJS0vKWWwUAAnjyk aGTYHQRLbDVi5+dyyLDX3OCF
=9MXY
-----END PGP SIGNATURE-----