Computer-generated digital characters could help treat autism by teaching scientists more about the act of mimicry.
A European research project is helping to pave the way for the further use of digital characters, known as avatars, in studying how humans interact.
‘Lots of people have been looking at things like social perception for years, how you see faces, but we want to get beyond seeing stuff and have people actually interacting to see how interaction works,’ said Dr Antonia Hamilton, the principal investigator of the INTERACT project.
‘I’d heard about the potential of avatar technologies and wanted to see what it can do,’ said Dr Hamilton, who has received a European Research Council grant to carry out the study. ‘It’s a very new technology and people are only just getting to grips with the enormous benefits it will bring to social neuroscience.’
Unconscious mimicry is believed to play an important role in social interaction, and the extent to which people mimic each other is thought to show how close they feel to each other. People can pick up another person’s emotions by mimicking them through a mechanism called facial feedback, where inner emotions are affected by facial gestures.
People with autism mimic in a different way from other people, and the causes for this remain unknown. Dr Hamilton's project aims to provide new insights into the origin of poor mimicry among people with autism. While autism is a complex condition, many researchers believe that this deficit in mimicry may be central to the development of autism.
Why use avatars?
It’s tricky for researchers to use real people for studying mimicry as there are too many variables in social interactions. That’s why Dr Hamilton has decided to work with avatars. By using an avatar, she can change just one variable – such as gender, or clothing – to see if it has any effect on the way people mimic.
It will allow her to examine whether people mimic more closely someone of the same gender, for example.
‘You could take a technology like this and then, if you know the detail of how typical mimicry works, you could teach people with autism to mimic in the same way.’
Dr Antonia Hamilton, principal investigator of the INTERACT project
For the experiment, subjects will sit at a desk in front of an avatar on a large screen, while the researchers observe how they react. The screen is equipped with movement sensors and sometimes the avatar will also be instructed to copy the gestures of the subject.
‘As the participant moves, the avatar can respond to them, or copy them, or do things that are genuinely interactive with what the participant is doing,’ said Dr Hamilton.
The only thing she tells the participants is that she wants them to listen to the avatars or watch their hand movements. The avatar then, for example, taps out a rhythm with its hand, and the researchers watch to see to what extent the subject copies the avatar.
She also watches whether the participant copies the avatar’s head movement, an unconscious form of mimicry that can show whether two people empathise with each other or not. ‘This is all unconscious, people don’t notice how much their head is moving, but if they sway at the same rate then they are more likely to like each other and believe the other person.’
Regions of the brain
As a second stage, Dr Hamilton will scan the participant’s brains as they copy the avatar, gathering data on which parts of the brain are active as people make the decision whether to mimic or not. She plans to use this data to help develop therapies for autistic people so they can learn to mimic more effectively.
‘You could take a technology like this and then, if you know the detail of how typical mimicry works, you could teach people with autism to mimic in the same way,’ she said. However, the project will not have results until the end of 2017, so it will take a while before the data could be used in this way.
She hopes her research will also be useful to game manufacturers as it will show what type of avatar behaviour people respond to best, allowing them to improve the way players interact with digital characters.
Avatars are already being used to train the US military, and Dr Hamilton believes the capability of today’s computers means that they will become increasingly common. They could be used, for example, to train business people in public speaking.
‘I could see avatars becoming much more ubiquitous in research, and in ten years’ time, beyond research,’ she said. ‘There will be more of these all over the place because I think the computing power and the software behind them is getting so much better.’
Few technologies have the potential to disrupt old institutions as much as blockchain – a system that maintains records on huge networks of individual computers. As with any new technology, it could be used for social good – such as supporting people who are priced-out of the current bank accounts – but the big challenge is how to limit its unintended consequences.
When an outbreak strikes, speed is critical. Health workers must act quickly not only to contain and treat an emerging or re-emerging disease, but also to use this window to evaluate potential treatments and vaccines. And the challenge becomes even greater in sub-Saharan Africa when you’re trying to develop new approaches in the face of multiple emerging diseases.
Nature provides people with everything from food and water to timber, textiles, medicinal resources and pollination of crops. Now, a new approach aims to measure exactly what a specific ecosystem supplies in order to incentivise decision-makers and businesses to help combat biodiversity loss.
Europe’s position on privacy, regulation and competition could be a key way to attract entrepreneurs who share those values but there is still some work to do in encouraging ambition, according to Nicklas Bergman, a Swedish entrepreneur and technology investor. Over the past two years, he and other entrepreneurs have advised the European Commission on the design of the European Innovation Council (EIC), an initiative to support companies, researchers and entrepreneurs hoping to start their own business or scale up their projects internationally. The second phase of the pilot was launched on 18 March 2019.
To protect species, we need to speak the language of business, say experts.
He has advised the EU on its new European Innovation Council.
Species loss needs urgent international action, says Prof. Georgina Mace.