We already did this discussion.
Check the Extropian archives.
Keyword: "Objective morality."
For my viewpoint, use Keyword: "Externalism."
--
sentience@pobox.com Eliezer S. Yudkowsky
http://pobox.com/~sentience/AI_design.temp.html
http://pobox.com/~sentience/sing_analysis.html
Disclaimer: Unless otherwise specified, I'm not telling you
everything I think I know.