The Ethical Roboticist

I strongly believe that researchers in intelligent robotics, autonomous systems and AI can no longer undertake their research in a moral vacuum, regard their work as somehow ethically neutral, or as someone else's ethical problem.

Researchers, we, need to be much more concerned about both how our work affects society and how interactions with this technology affect individuals.

Right now researchers in intelligent robots, or AI, do not need to seek ethical approval for their projects (unless of course they involve clinical or human subject trials), so most robotics/AI projects in engineering and computer science fall outside any kind of ethical scrutiny. While I'm not advocating that this should change now, I do believe – especially if some of the more adventurous current projects come anywhere close to achieving their goals – that ethical approval for intelligent robotics/AI research might be a wise course of action within five years.
Let me now try and explain why, by defining four ethical problems.

1. The ethical problem of artificial emotions, or robots that are designed to solicit an emotional response from humans

Right now, in our lab in Bristol, is a robot that can look you in the eye and, when you smile, the robot smiles back. Of course there's nothing 'behind' this smile, it's just a set of motors pulling and pushing the artificial skin of the robot's face. But does the inauthenticity of the robot's artificial emotions abnegate the designer of any responsibility for a human's response to that robot? I believe it does not, especially if those humans are children or unsophisticated users.

Young people at a recent Robotic Visions conference concluded that “robots shouldn't have emotions but they should recognise them”.

A question I'm frequently asked when giving talks is “could robots have feelings?”. My answer is “no, but we can make robots that behave as if they have feelings”. I'm now increasingly of the view that it won't matter whether a future robot really has feelings or not.

On the horizon is robots with artificial theory of mind, a development that will only serve to deepen this ethical problem.

2. The problem of engineering ethical machines

Clearly for all sorts of applications intelligent robots will need to be programmed with rules of safe/acceptable behaviour (c.f. Asimov 'laws' of robotics). This is not so far fetched: Ron Arkin, roboticist at Georgia Tech has proposed the development of an artificial conscience for military robots.

Such systems are no longer just an engineering problem. In short it is no longer good enough to build an intelligent robot, we need to be able to build an ethical robot. And, I would strongly argue, if it is a robot with artificial emotions, or designed to provoke human emotional responses, that robot must also have artificial ethics.

3. The societal problem of correct ethical behaviour toward robot companions or robot pets

Right now many people think of robots as slaves: that's what the word means. But in many near term applications it will – I argue - be more appropriate to think of robots as companions. Especially if those robots - say in healthcare – even in a limited sense 'get to know' their human charges over a period of time.

Our society rightly abhors cruelty to animals. Is it possible to be cruel to a robot? Right now not really, but as soon as we have robot companions or pets, on which humans come to depend – and that's in the very near future – then those human dependents will certainly expect their robots to be treated with respect and dignity [perhaps even to be accorded (animal) rights]. Would they be wrong to expect this?

4. The ethical problem of engineering sentient machines

A contemporary German philosopher, Thomas Metzinger, has asserted that all research in intelligent systems should be stopped. His argument is that in trying to engineer artificial consciousness we will, unwittingly, create machines that are in effect disabled (simply because we can't go from insect to human level intelligence in one go). In effect – he argues - we could create AI that can experience suffering. Now his position is extreme, but it does I think illustrate the difficulty. In moving from simple automata that in no sense could be thought of as sentient to intelligent machines that simulate sentience we need to be mindful of the ethical minefield of engineering sentience.

In summary:

What is it that makes intelligent autonomous systems different to other technologies in a way that means we need to have special concerns about ethical and societal impacts? It is, I suggest two factors in combination. Firstly, agency. Secondly, the ability to elicit an emotional response or in extremis dependency from humans. Right now we have plenty of systems with agency, within proscribed limits, like airline autopilots or room thermostats. We also have machines that generate emotional responses: Ferraris or iPods. Intelligent robots are different because they bring these two elements together in a potent new combination.

---

This post is the text of the statement I prepared for the EPSRC Societal Impact Panel in November 2009.

Mimetic Factors in Health and Well-being

On Monday I gave a talk at an amazingly interesting workshop in Warwick. Part of a project called Mimetic Factors in Health and Well-being, the workshop brought together a very diverse range of disciplines: sociology, medicine, systems science and robotics (and I may have missed a few).

Project lead, Steve Fuller, gave a great talk which reflected on both memetics (pre-Dawkins), and mimesis in advertising and PR. I found myself being introduced first to French sociologist Gabriel Tarde who, who - according to Steve Fuller - first articulated the pivotal role of imitation in society. Then to contemporary French social and cognitive scientist, and by the looks of it all round genius, Dan Sperber. I can see that I have to add Sperber to my reading list!

Can I have a robot for Christmas?

I was delighted to be asked to give the annual Christmas lecture to the Nottingham Medico Chirurgical society last night, in the medical school of the famous Queens Medical Centre, Nottingham. Founded in 1828 Nottingham Med-Chi, as they like to call themselves, is one of the oldest such societies in the UK. It was a great audience, with a healthy mix of children and very eminent medics who together kept me on my toes when it came to questions and answers.

In my talk I focus on the current strong convergence of biology and robotics, but in reflecting and speaking with the medics afterwards I was struck that the next big convergence in robotics (perhaps the next wave after biology) will be with medicine. As our understanding of the human body and its astonishingly complex processes and mechanisms deepens, then - in a sense - medicine becomes more like ultra precision engineering. And as robotics moves toward artificial life, then engineering robots becomes far removed from mechanical and electrical engineering and more like bio-medical engineering. For a good example look at the BRL's Ecobot III, with all of its plumbing and bio-chemistry. Hence the convergence I predict.

Postscript: the Notts Med-Chi society is very firmly in the 21st C: I discovered my Christmas lecture can be downloaded as a podcast on iTunes.

Robot ethics at the EPSRC societal issues panel

Tough afternoon yesterday. Why? I'll come to that. Along with the other senior media fellows, I attended EPSRC's Societal Issues Panel, chaired by Robert Winston. Before getting the invitation I didn't know about this group, but came away very impressed with just how deeply serious EPSRC is about engaging with public attitudes and concerns about science research and the potential societal impact of its funded research programmes.

As the new boy there wasn't much I could contribute to the main session, when the panel wanted to hear from the senior media fellows about their experiences and what more, or differently, the panel could do in its work. But listening to the SMFs experiences was for me incredibly useful. It was like getting a master class from not one but a whole group of virtuosi, concentrated into two hours.

But the tough bit was to follow. Noel Sharkey and I had been asked to stay for another agenda item on the potential ethical and societal impact of intelligent robots, artificial intelligence and autonomous systems. Noel and I each gave short introductions to what we thought were the main issues and I focussed on the ethical questions raised by research in intelligent robotics - i.e. the ethical roboticist.

postscript: The Ethical Roboticist

e-pucks in Osaka

Gave some Walking with Robots talks at an elementary school today, in Ikeda Japan (near Osaka). The e-pucks were a great success with the children, and were joined by some amazing Japanese robots, like Paro - the robot seal. Pictures to follow...

The robots are coming (to Manchester)

If you're in or around Manchester Saturday 24th - Tuesday 27th October, do come and see us at the Walking with Robots festival of robotics - part of the Manchester Science Festival.

Here are links to the events:

• Footballing robots
• A pub guide to robots
• Robot scenes
• Robotics networking event
• Robots in the home: Coming soon or urban myth?
• Walking with Robots: What are the questions?
• Robo-mania at the Museum of Science and Industry

Surrogates: not a review

Surrogates. Not a great movie* but thought provoking in a possible-robot-futures kind of way. The first thing that made it interesting was that the imagined robotic technology doesn't rely on Artificial Intelligence (AI), unlike most robot sci-fi. In that sense, therefore, its fictional future is rather more plausible than most robot movies, although still very challenging. In the Surrogates future humans put on some kind of headset that enables them to see through their robot's cameras, hear through its microphones and (presumably) smell through its olfactory sensors. This is a Brain-Computer Interface (BCI); there are two kinds of BCI, non-invasive - as in this movie, or invasive (the Matrix).

For me, however, the most interesting question raised by the movie is this. If you had the opportunity to live your life through a beautiful robot proxy, so that you see, hear and touch the world not directly but through its senses, and you interact with (most) other people even more indirectly, via their surrogates, would you..? Not just occasionally, for fun, but 24-7 - work and play. Would the experience be so compelling, so addictive, that it justifies spending your days lying prone on a couch jacked into an immersive real-reality, emerging only to pee and eat pizza (delivered presumable by surrogates)? Would social pressures or fashion compel you to surrogate-up, otherwise as a real human - lumpy and unattractive (not you dear reader) - you find yourself in a world of super-model surrogates?

-------------------------------------------------------------
*Although I thoroughly enjoyed it. The plot is thin and predictable but Bruce Willis and his wife (played by Rosamund Pike) are excellent. And the makeup of the human-actors-playing-surrogates provoked in me a not-quite-out-of-the Uncanny Valley response, that really held my attention.

Now I can really focus on Research and Public Engagement

1st October today and a new job within UWE. I'm seconded out of my associate dean role(s) within environment and technology so that I can start my senior media fellowship. At the same time I take on the new role of director of UWE's science communication unit. For the next three years I'll be able to focus all my energy on two things I'm really passionate about: research and public engagement. I feel very privileged to be in this position: I'm very grateful to the EPSRC, to colleagues at UWE for making the space for me to be able to do this, and looking forward to working with the amazing team in the SCU.

Artificial Culture in Warwick

Yesterday we had a full artificial culture project team meeting in Warwick, following on from the EmergeNet meeting on Thursday (see my previous blog post). An excellent meeting, significant because we are now exactly half way through the project. Having spent much of the first two years of the project building the artificial culture lab, the project is now moving into the experimental phase. Having built our microscope we can now start looking through it.

The experimental phase of the project brings new challenges and we spent much of yesterday's meeting discussing and crystallising the detailed research questions that our experiments must address. Of course project team members each have questions and ideas that we want to address within our respective disciplines, but there must be overarching project-wide questions. Alistair led this discussion, wisely warning against the 'so what' problem ("Hey we've discovered x. Hmm interesting, but so what"). Taking a theory motivated approach, Alistair proposes four research questions addressing some key problems with the memetic theory of cultural evolution:

1. What is the effect of fidelity of imitation on meme transmission?
2. What is the effect of selection?
3. What is the effect of size/granularity (of the meme)?
4. What is the effect of complexity within the meme?

Encyclopaedias and Emergence in Warwick

Here at the University of Warwick this week for the European Conference on Complex Systems.

Unexpectedly, Springer also used the conference to launch their excellent new Encyclopaedia of Complexity and Systems Science. As an author of one of the articles in the encyclopaedia - on Foraging Robots - it was great to see all 11 volumes and my article, in print, for the first time. Editor in chief Bob Meyers did the formal launch last night and (perhaps not suprisingly) there were four or five contributors here in Warwick. Bob called a couple of us out of the audience to say a few words, which was great. I made the points that complexity science is a wonderful unifier of multiple disciplines - everything from cell biology to economics - and that the grand challenge is to find unifying principles of emergence and self-organisation.

Today is the EmergeNET3 workshop. James Crutchfield gave a terrific invited talk about emergence, which he defines as a change in a system's causal architecture. He outlined his computational mechanics framework for analysing emerging patterns, and gave examples from cellular automata. Very interesting, but I was left wondering if Jim's framework would transfer well from the ideal grid-world of cellular automata, to the continuous time and space of swarm robotics, with rather more complex agent behaviours, real-world physics and noise. I suspect not.

Killer robots in the news again

I was interviewed by John Arlidge on Saturday, researching for a piece on the American Association for Artificial Intelligence meeting, earlier reported in the New Scientist with the title Smart machines: what's the worst that could happen.

John's article in the Sunday Times was, in my view, a more-or-less reasonable account of what's actually a rather dull story: a group of senior researchers in AI getting together to discuss setting up ethical and design guidelines for future AI-based systems. Well good. That's what we should expect to happen and, indeed the AAAI group are probably a bit late off the mark. An EU initiative in Roboethics has been underway since 2004/05: here is a recent draft of the EURON Roboethics Roadmap; the South Korean government have been reported to be working on a robot ethics charter, and the venerable International Standards Organisation (ISO) have had a group working for a couple of years now on a new ISO standard for intelligent robots.


Unfortunately a sub-editor (I guess) chose to give the piece the lurid title: Scientists fear a revolt by killer robots. Sorry guys. I know it doesn't make for good headlines but we scientists do not fear a revolt by killer robots.







Yes, autonomous robots will demand some new - possibly radical - approaches to safety, reliability and ethics and, yes, a good deal of effort needs to go into this, but the fact that these efforts are going on is not because of some secret fears of killer robots taking over. Just good engineering practice.

Installing Player/Stage on OS X with MacPorts

Back in 2006 I wrote about installing the excellent Player/Stage robot simulator under Linux, and the problems caused by dependencies (i.e. other packages that need to be installed first, before you can then install Player/Stage). Wouldn't it be great, I wrote, if there were a universal installer programme that would sort out all of these dependencies.

I should explain that since that post I've switched from Linux to OS X, running on a MacBook Pro, and have only just got round to installing Player/Stage. I was very pleased to discover that my plea for a universal installer has been answered by the (almost) excellent MacPorts.

I say almost excellent because installation wasn't completely glitch free.

Here's what I had to do to install to Mac OS X 10.5.7 (Leopard)

1. Download and install XCode (MacPorts depends on it)

2. Download and install MacPorts, install details here

3. In a terminal window run MacPorts with
$ sudo port install playerstage-stage playerstage-player

And wait an hour or so - it takes awhile. However, compilation of playerstage-player fails library not found for -ljpeg. To fix this as detailed here:

4. sudo port install python_select && sudo python_select python25

then re-run step 3.

5. But before you can run Player/Stage there's another fix needed, as detailed here.

sudo ln -s /usr/X11/share/X11/rgb.txt /usr/X11R6/lib/X11/rgb.txt

And that's it. Player/Stage installed.

Letter to the Times Higher

Here is the full text of my letter in this week's THE:

Sir,

I am dismayed by the poor quality of journalism shown in the article Sandpits bring out worst in infantilised researchers. Of the two academics quoted the first, Professor Docherty, hasn't been to a sandpit; a second, unnamed, researcher apparently hadn't either, instead reporting what some bloke had said to him at a conference. Come on THE, you can do better than this. It can't be that hard to find one or two participants prepared to offer opinions on the record, from the 25 sandpits so far. The piece is depressing also in its use of the pejorative trope 'reality-TV' without justifying it. I recall nothing even vaguely reality-TV-like about the sandpit I attended. And micromanaged? Yes the the week was skilfully managed – but how else can you go from 30 more or less complete strangers to coherent project teams and amazing proposals in 5 days? In fact there was a significant level of self-organisation going on within the sandpit framework. And what on earth is wrong with the word sandpit? The key to creativity is working with people outside your own discipline, outside your intellectual comfort zone; the analogy with play and exploration is apt. To be brought together with 30 very, very smart people and asked to think about big research questions is exhilarating, not infantilising.

Yours faithfully

Robotic Visions at At-Bristol

The first Robotic Visions conference has started here in the Science Learning Centre of At-Bristol! We have around 25 students from 4 schools. As the day progresses I'll be posting updates, and some pictures, here:

2.00pm The five groups have come up with their big issues:

1. Robots looking after us
2. Robots Venturing into Space
3. Robot Family and Friends (companions)
4. Robot Teachers and Trainers
5. Equal access to Robot Technology for rich and poor

What a great set of issues. Especially the last one.

5.00pm We just finished the celebration session in which the five groups presented their findings and recommendations to the invited VIPs. Four of the groups elected to have show and tell presentations with posters and written material - all of which were brilliant. The 'equal access' group, instead read out a powerful and moving statement that was both critical of technology for technology's sake, when set against real issues such as poverty, while at the same time calling for a strong ethical approach to robotics. Hopefully I can get hold of a copy of that statement and post it here.

Scratchbot in the news

Check our this Youtube video of the amazing Scratchbot built my my colleagues at the Bristol Robotics Lab:



This robot not only has artificial whiskers, that 'whisk' just like real rodents' whiskers, but even more amazingly it processes the sense data from the whiskers with a high-fidelity electronic model of the barrel cortex - the small part of the rat's brain that processes sensory input from its whisker's. If you look carefully you can see the micro-vibrissae - the small extra-sensitive non-whisking whiskers at the robot's snout.

Here's the full story on the EU Cordis news service.

Chimpanzee culture on Material World

There was a great piece on this afternoon's Material World - an interview with Andrew Whiten about cultural traditions in chimpanzees. Andrew Whiten makes the very interesting observation that while many animals appear to have 'traditions' (i.e. separate groups of the same bird species with different birdsong), chimpanzee have dozens of traditions. Does this mean that chimps have culture? I think so, yes.

Chimp culture appears, however, to have remained relatively static - Whiten observes that archeological investigation has shown traditions to have persisted for hundreds if not thousands of years. Longer, I would suspect, given that anatomically modern chimps have been around for over six million years. In other words, the big bang of human cultural evolution has never happened for chimps. What cognitive deficit in chimps might account for this..?

Artificial Culture web pages now up

Check out our new Artificial Culture project web pages:



These have been built using Google Sites. A remarkably straightforward way to create both the structure and content for a set of web pages, without HTML coding (actually I did have to tweak the code a couple of times). Integration with other Google applications means, for instance, that creating a slide show of images needs you only to upload the images to a Picasa album, then insert the slideshow gadget and point to the Picasa URL. Add another image to the album and it automatically appears in your web site slide show.

There is one limitation: while invited collaborators can sign-in and add comments - in blog fashion - to existing posts (as well as create and edit new pages), ordinary visitors to the web site cannot. Given that blog functionality is clearly built into the sites technology, it ought to be straightforward to provide an option to allow comments to be submitted, to selected pages, by non signed-in visitors. Or a blog gadget. Google..?

Autonomous robots with guns are a bad idea

Check out Noel Sharkey's excellent piece describing the depressingly relentless 'advance' of offensive robots, in today's Daily Telegraph: March of the Killer Robots.

Like Noel I am profoundly worried by the weaponisation of robots.

Robotics a key future industry

Great to see an independent report listing robotics as one of the key future industry sectors for the UK in today's Guardian: uk industry set to put its best robotic foot forward. (Notice also the brilliant photograph of the amazing hand on the BRL/Elumotion robot BERTI.)

There's clearly something in the air because just a couple of days ago blogs were discussing the launch of a US National Robotics Technology roadmap. Here's an interesting quote from the briefing paper "robotech represents one of the few technologies capable in the near term of building new companies and creating new jobs and in the long run of addressing issues of critical national importance".

Artificial Culture in Prague

I'm here at the brilliant European Union conference Science beyond Fiction, and yesterday gave my talk in the session on Collective Robotics: adaptivity, co-evolution, robot societies. I was pretty nervous because (a) this is my first talk on the Artificial Culture project to a international audience of senior researchers and (b) the project is still in its early development stages so we don't yet have any results. However, I'm pleased to say the talk went down well and I had some great questions - followed by conversations late into the evening.

Here is a movie of my presentation slides:


One of the questions was about robot imitation: are the robots learning to imitate, or have we pre-programmed them with imitation? My answer was that we have hand-coded imitation, in other words, our robots are endowed with an imitation instinct. You have to start somewhere, I argued, and this seems a good place to start and will initially allow us to study meme-evolution in our robot society in isolation from robot adaptation. While my questioners agreed, they also suggested that the evolution of imitation would also be really interesting, and encouraged us to - in effect - turn the evolutionary clock a little further back in our robot model of the emergence of culture.

Here are all of my blog posts on this project so far.