Transhuman Goodness is Roko Mijic's virtual soapbox; on these pages you'll find posts about about emerging technologies, values, ethics and philosophy, the humanity plus movement, artificial intelligence, and a whole assortment of futurist and humanist topics.

 

Transhumanism and the need for realist ethics

Last time I talked about ethics, and claimed that the realism/antirealism debate is especially important to transhumanists. I should note that at least two different people have cited something along these lines as a serious objection to the transhumanist project: Marika writes (via email):

“What, according to transhumanism, gives human life meaning and purpose, and if there isn't anything, then how are people supposed to let go of what seems to be a pretty deeply ingrained habit of wanting meaning?”

Stann writes, in the comments to a previous post:

“We may know one day how it all works, but if we can't discern any "value" to go with the motions, what do we have? After all, everything is just matter and energy, why is any form of it superior to another?”

These are not easy questions to answer, and there’s no way that I can provide a full analysis in a few blog posts. But I’ll try to elucidate why I think the transhumanist project needs to pay a lot of attention to these kinds of questions, and propose some solutions.

The average person in, say, Britain, has a fairly good intuitive idea of what counts as a “good outcome” in his/her own life.

  1. Having a prestigious education and getting a prestigious, well paid job are both good.
  2. Having money is good.
  3. Having friends is good.
  4. Having a nice house with suitable décor is good, as is the possession of an expensive car/watch/[insert gadget here].
  5. Having a good time at parties, discos and social events is good, as are sexual experiences [with attractive people, and not too many sexual partners, especially if you are female].
  6. Having an attractive partner and [once you reach a suitable age] a spouse and kids are good. Love (commitment and genuine care for your partner) is good.
  7. [for some minority] Worshipping a god is good, as is converting people to your religion.

I will refer to these commonly held good outcomes as commonsense values, in analogy with commonsense morality. The notion is relative to a particular culture: I have described the commonsense values of the UK as I see them, one could describe the commonsense values of other countries and get a somewhat different collection. An honest examination of the list (1-6) in the light of evolutionary psychology reveals that, in the absence of any scientific theory of what to do with our lives, we have simply stuck to the inbuilt motivations that our selfish genes give us, even though we have no interest in the ultimate aim that our desires were designed to achieve – namely maximizing our inclusive genetic fitness. If my aim were to maximize my genetic fitness, I would go around donating to sperm banks and generally try to have as many children as I could. Eliezer Yudkowsky expressed this by saying that we are “Shards of Godshatter":

"Yet when the blind idiot god created protein computers, its monomaniacal focus on inclusive genetic fitness was not faithfully transmitted. Its optimization criterion did not successfully quine. We, the handiwork of evolution, are as alien to evolution as our Maker is alien to us. One pure utility function splintered into a thousand shards of desire."

(1-6) may not be an entirely bad set of motivations to have: for example love may be a good thing even though it was originally “invented” by our genes for the purposes of making a man and a woman co-operate to bring up a child. We should, however, question our commonsense values and be prepared to abandon or modify them.

Transhumanism asks people to reconsider what they think of as good outcomes in life – to move somewhat away from their commonsense notions of what counts as valuable. (E.g. See Nick Bostrom “core transhumanist values”) We ultimately want to convince people that existence as an uploaded personality on a computer could be as valuable as existence in a moving piece of meat called a human body. We want to convince people that there is value in letting people change the fundamental properties of their bodies, for example by interfacing themselves with computers or by altering the way the reproductive process works [germ line genetic modifications come to mind]. We want to convince people that death is a bad thing at any age, and that there is nothing wrong with wanting to live for many hundreds or thousands of years. Most of us want to convince people that obtaining one’s notion of what counts as good from religion is a mistake. In fact there isn’t actually a huge amount of agreement amongst transhumanists as to exactly what we should replace commonsense values with, which is a bit of a problem!

If transhumanism is to be successful in convincing large numbers of people to move away from commonsense values towards other values, we need to have a scientifically or mathematically compelling argument which points to what people ought to value instead. Wordy arguments of philosophy are clearly not going to be enough, and it is unlikely that people will be convinced to change what they value if you tell them that all things are equally valuable/valueless, or that the notion of “objective value” makes no sense: in the absence of any serious ethical guidance, people will stay exactly where they are – status quo bias. This effectively says that transhumanism is either a realist theory or a failure from the start.

But a compelling realist theory is more than just a rhetorical device. We, the transhumanists, cannot say exactly what is going to be good or bad in the far future, or even what the relevant considerations are.

Would it be better if all minds were merged into one big mind, or are individual personalities a good thing? Would it be ethical to destroy the entire human race to build computer power for a really big, really intelligent AI? Is it ethical to upload someone without their permission? What kind of motivations should we give to an AGI? Can there be such a thing as an AI slave, and should we give human rights to nonhuman intelligences? How much freedom should people be given to alter their own minds and motivations – should we have something like “thought police”? Is privacy (of thoughts or of acts) a good thing or a bad thing? Do we have an ethical obligation to colonize the entire universe?

Transhumanists are advocating radical changes from the current norm [or at least we are the ones thinking about radical changes that are probably going to happen and how we might sway things one way or another], so we must carefully examine our underlying assumptions about what is good and what isn’t. The neo-luddite value-stance that things are OK the way they are and that we should avoid meddling doesn’t need as much careful justification as the transhumanist value-stance that we should radically change things: if the luddites turn out to be wrong, we’ll just have wasted some time by listening to them; if the transhumanists turn out to be wrong, there might not be a second chance. [Of course the neo-luddite value stance, as appealing as it might be, is probably practically untenable]

16 comments:

Richard Leis, Jr. said...

The experiences and lessons learned from other social movements - the race, LGBT, feminist and other movements - may be useful here. For example, some of the commonsense values listed and many more have been reevaluated by past movements.

Coathangrrr said...

I'd suggest checking out Genealogy of Morals by Nietzsche, a lot of what he talks about is relevant to transhumanism, especially to morality/vlues and transhumanism. Don't be scared off by the history behind the name, he is not what a lot of people say he is.

I'd suggest the Kaufmann translation.

Coathangrrr said...

I'm going to add some more thoughts I've had. First, I think that 'commonsense values' might now be the best term. I think something like 'superficial values' or even 'desired outcomes', superficial not in a derogatory way, but meaning that they aren't the real values. I say this because in the first six cases the values are not values in and of themselves for the majority of people. Most people, if pressed on the issue, will concede that they don't want money or a big house in and of itself but for the happiness or security it brings them. There are of course people who do indeed want those things in and of themselves, money for moneys sake and not for what it can buy them; a big house because simply having a big house makes them feel good, not because it offers them more security.

The God value is a bit more difficult to breakdown like that, and might indeed be a 'base value' of sorts. Maybe one could view happiness and security as base values as well. Under this scheme the good in the transhumanist agenda becomes more apparent. If what we really want is security then it seems that there are many things transhumanism can offer that provide that, in theory at least. Ditto for happiness.

I'll be honest, I'm skeptical of technology as some sort of panacea, and I think it does no good to simply call those who oppose technical advancements "Luddites," mainly because they aren't always critiquing technology in general, but a specific technology which may in fact be crappy for the world to have a lot of. I think cars fall into this category and I don't think that makes me a Luddite.

Aric said...

Great post. I see this as the most important question for transhumanists to answer. It's what separates a transhumanist from a guy who wants a cool chip in his head. It's the question of what makes a better human (or better-than-human), instead of a human with a better _____.

"Most of us want to convince people that obtaining one's notion of what counts as good from religion is a mistake."
And you would be right most of the time, in that dogma is the wrong place to look. Meditative traditions, on the other hand, have for thousands of years been answering the exact questions that transhumanism faces.
"Who am I?"
"How can I best relate to my desires?"
"How do I act in ways that cause lasting benefit to myself and others instead of only temporary pleasure or temporary relief from pain?" (more commonly known as 'Getting off the wheel of Karma')
I don't see how one can hope to improve on the human race without having answers to these questions.

I personally would be glad to hand over the evolutionary torch to creatures which are capable of having more meaningful lives than humans. On the other hand, it may be possible to create creatures which are more capable than humans in every way, yet which cannot enjoy. If such creatures were to become the dominant intelligence it would be a tragedy.

Roko said...

@Coathangrrr: "Most people, if pressed on the issue, will concede that they don't want money or a big house in and of itself but for the happiness or security it brings them."

- I'm not so sure. Do you think most people would be happy to take a pill which would make them feel rich and make them think that their grotty flat was actually a gleaming mansion? I don't think so: people would object that it "isn't real". People really really do want the things themselves. Most people, I think, would not take a "happy pill", and I think that they are right to not do so.

But in any case, I think that if people really would accept the illusion of wealth and status and material goods rather then the wealth and status themselves, I don't think it affects the arguments I'll make that much.

Roko said...

@ Aric: I personally would be glad to hand over the evolutionary torch to creatures which are capable of having more meaningful lives than humans.

Interesting! I disagree with you, mostly because I think the whole question relies too much on some kind of unambiguous essence of personhood that's probably false: I think that if you create some new being [e.g. an AI] who has almost exactly the same mental state as you do, perhaps with some improvements that you would have liked to have yourself, and then kill your meat-body, you haven't really died, you've effectively uploaded yourself.

Anyway, nice to hear your opinions!

Roko said...

@Richard Leis:

yeah, I think we can learn from the LBGT movement, feminism, and especially environmentalism. But these movements have only had to tweak people's values a little bit, and in the case of the LBGT movement, have still not wholly succeeded in overcoming the "Yuck!" factor that people associate with unconventional sexual practices.

It's a good point: people have succeeded before.

Coathangrrr said...

People really really do want the things themselves.

But only because they get happiness from them. If I were to offer someone a big house for free but explain to them that it wouldn't make them happy, they would probably still take it, not believing me; but, if they actually did believe that a big house wouldn't make them happy, they wouldn't take it, even if they thought a big house should make them happy.

Roko said...

@coathangrrr:

I think this depends on exactly how you define "happy". Are you familiar with the research that shows that, in the long run, what happens to us in our lives, including winning the lottery or being severely disabled, does not make us happy: rather we have an in-built level of happiness which is genetically determined.

Of course as far as the arguments I will make go, it doesn't matter whether people strive to get big houses because they go after whatever they believe will make them happy and they falsely believe that a big house will make them happy, or because they just regard a big house as being of intrinsic value. In fact I would question whether there is any difference between these two scenarios: Do you or I have any difference in terms of anticipated experience? Are we making the "if a tree falls in the forest does it make a sound" type mistake?

Suppose I taboo the word "happy". Do we still disagree about anything?

Coathangrrr said...

I'm strongly critical of much of Evolutionary Psychology, I find it to have gaping theoretical holes. Not to say it doesn't have potential, but the place it is right now seems to be rather in the far, far early stages.

Given that, I am quite skeptical of current genetic explanations of happiness, though I think it entirely possible.

Suppose I taboo the word "happy". Do we still disagree about anything?

Probably not. There are goods of derivative value and goods of intrinsic value, that's the important distinction.

Arenamontanus said...

You do not have to assume happiness setpoints are set by genetics, it could be the in utreo environment or early childhood experiences; the data is pretty clear that people tend to gravitate towards a particular level that is very robust against external circumstances and relatively unchanging across life. Happiness level is probably about as elastic as other personality traits.

Based on the original post, I did a small response on my blog where I express mild scepticism and suggest that open-endedness might be a key transhumanist value.

Coathangrrr said...

I've put up a response to this a well, basically rejecting moral realism except as necessary for arguing for the transhumanist project.

Rolf Nelson said...

We want to convince people that ... (long list omitted)

I would prefer to aid people in discovering and achieving the things that they "really" want (roughly, the things they would want after sufficient reflective thought) rather than trying to impress on them the things that I personally consider valuable.

We want to convince people that death is a bad thing at any age, and that there is nothing wrong with wanting to live for many hundreds or thousands of years.

Most people would, when given the choice, choose not to die. It might be more accurate here to take the economist's viewpoint of judge people's desires here by their actions rather than by their words; people say all sorts of weird things when they know they won't be held to the logical consequences of their verbal utterances.

hugh said...

Quoting Roko
"Do you think most people would be happy to take a pill which would make them feel rich and make them think that their grotty flat was actually a gleaming mansion? I don't think so: people would object that it "isn't real"."

You have obviously not known many junkies, some of whom are literally doing just that.

Roko said...

@Rolf: I would prefer to aid people in discovering and achieving the things that they "really" want (roughly, the things they would want after sufficient reflective thought) rather than trying to impress on them the things that I personally consider valuable.

In a way, I can sympathize with this sentiment. What you've said hinges very much on what you mean by "sufficient reflective thought". Some people might reflect on life and decide that they want to kill everyone in the whole world. You wouldn't want to help them achieve that!

The advantage of being in a realist world (where there are objective ethical truths) is that you don't have to worry about the things that "you personally" consider valuable. There are simply some things that are *objectively* of value.

Rolf Nelson said...

Some people might reflect on life and decide that they want to kill everyone in the whole world.

Here are some under-specified options for dealing with Charles Manson.

Solutions that directly fulfill desires:

1. I will fight Manson, because each person that Manson is trying to kill, does not desire to die. (Libertarian solution)

2. I will fight Manson, because Manson's utility-gain from killing is smaller than the victim's utility-loss from dying. (Statist solution)

Indirect solutions that fulfill desires about how desires should be fulfilled:

3. I will fight Manson, because I, personally, directly desire that the Libertarian solution hold in this case; that is, I may have a list of well-thought-out exceptions to Libertarian rules, but none of them apply in a case such as this. (Selfish solution)

4. I will fight Manson, because almost everyone agrees that the Libertarian solution should be applied in such cases; that is, they may have a list of well-thought-out exceptions to Libertarian rules, but none of them apply in such a case as this. (Democratic solution)