Yes. Or more unambigously: desires. And then we can take a step
further, and ask: Which desires? I can be argued that
it will the *higher-order* desires of the influential persons in
the society wherein the first SI is developed that will fix and
determine all the future evolution of in a growing sphere centered
around earth. See the section about Values and Social Attractors
in my paper Predictions from Philosophy? at
http://www.hedweb.com/nickb/predict.htm
Nicholas Bostrom
n.bostrom@lse.ac.uk