Computer-generated digital characters could help treat autism by teaching scientists more about the act of mimicry.
A European research project is helping to pave the way for the further use of digital characters, known as avatars, in studying how humans interact.
‘Lots of people have been looking at things like social perception for years, how you see faces, but we want to get beyond seeing stuff and have people actually interacting to see how interaction works,’ said Dr Antonia Hamilton, the principal investigator of the INTERACT project.
‘I’d heard about the potential of avatar technologies and wanted to see what it can do,’ said Dr Hamilton, who has received a European Research Council grant to carry out the study. ‘It’s a very new technology and people are only just getting to grips with the enormous benefits it will bring to social neuroscience.’
Unconscious mimicry is believed to play an important role in social interaction, and the extent to which people mimic each other is thought to show how close they feel to each other. People can pick up another person’s emotions by mimicking them through a mechanism called facial feedback, where inner emotions are affected by facial gestures.
People with autism mimic in a different way from other people, and the causes for this remain unknown. Dr Hamilton's project aims to provide new insights into the origin of poor mimicry among people with autism. While autism is a complex condition, many researchers believe that this deficit in mimicry may be central to the development of autism.
Why use avatars?
It’s tricky for researchers to use real people for studying mimicry as there are too many variables in social interactions. That’s why Dr Hamilton has decided to work with avatars. By using an avatar, she can change just one variable – such as gender, or clothing – to see if it has any effect on the way people mimic.
It will allow her to examine whether people mimic more closely someone of the same gender, for example.
‘You could take a technology like this and then, if you know the detail of how typical mimicry works, you could teach people with autism to mimic in the same way.’
Dr Antonia Hamilton, principal investigator of the INTERACT project
For the experiment, subjects will sit at a desk in front of an avatar on a large screen, while the researchers observe how they react. The screen is equipped with movement sensors and sometimes the avatar will also be instructed to copy the gestures of the subject.
‘As the participant moves, the avatar can respond to them, or copy them, or do things that are genuinely interactive with what the participant is doing,’ said Dr Hamilton.
The only thing she tells the participants is that she wants them to listen to the avatars or watch their hand movements. The avatar then, for example, taps out a rhythm with its hand, and the researchers watch to see to what extent the subject copies the avatar.
She also watches whether the participant copies the avatar’s head movement, an unconscious form of mimicry that can show whether two people empathise with each other or not. ‘This is all unconscious, people don’t notice how much their head is moving, but if they sway at the same rate then they are more likely to like each other and believe the other person.’
Regions of the brain
As a second stage, Dr Hamilton will scan the participant’s brains as they copy the avatar, gathering data on which parts of the brain are active as people make the decision whether to mimic or not. She plans to use this data to help develop therapies for autistic people so they can learn to mimic more effectively.
‘You could take a technology like this and then, if you know the detail of how typical mimicry works, you could teach people with autism to mimic in the same way,’ she said. However, the project will not have results until the end of 2017, so it will take a while before the data could be used in this way.
She hopes her research will also be useful to game manufacturers as it will show what type of avatar behaviour people respond to best, allowing them to improve the way players interact with digital characters.
Avatars are already being used to train the US military, and Dr Hamilton believes the capability of today’s computers means that they will become increasingly common. They could be used, for example, to train business people in public speaking.
‘I could see avatars becoming much more ubiquitous in research, and in ten years’ time, beyond research,’ she said. ‘There will be more of these all over the place because I think the computing power and the software behind them is getting so much better.’
Tiny pieces of plastic, now ubiquitous in the marine environment, have long been a cause of concern for their ability to absorb toxic substances and potentially penetrate the food chain. Now scientists are beginning to understand the level of threat posed to life, by gauging the extent of marine accumulation and tracking the movement of these contaminants.
A team of experienced science divers has created the world’s first submersible touchscreen for a tablet computer, whose applications are already helping marine scientists, law enforcement, explorers and other professionals toil beneath the waves and could usher in a new era of underwater ICT.
The world’s largest radio telescope, known as the Square Kilometre Array (SKA) and situated over two continents, will be able to detect the first stars and galaxies emerging from the ‘murk’ at the beginning of the universe and much more besides, according to Professor Phil Diamond, Director General of SKA. He spoke to Horizon at the opening of the Shared Sky art exhibition in Brussels, Belgium on 16 April, where indigenous artists from SKA host nations South Africa and Australia use traditional painting and folk art to explore the themes of astronomy, spirituality and a borderless sky.
Electric ferries and digital communication between ships could help in the quest to decarbonise maritime transport, a sector which is often perceived as being the green option but could still do much to lower its environmental footprint.
Tiny plastic particles could impact human health.
Astronomers could use giant radio telescope from 2025.
The EU’s research chief on his new role.