If you’ve ever stood close to a bass speaker in a nightclub, you know what it’s like to feel sound.
A UK-based start-up is rolling out technology that uses this principle to let you feel and manipulate shapes in mid-air, and it’s going to change the way you interact with your car, your home and even how you play computer games.
‘We’re not here to abolish all keyboards and all touch-based interfaces and get rid of all buttons,’ said Tom Carter, the 26-year-old co-founder of start-up Ultrahaptics. However, he believes that devices that can read hand movements and give feedback in mid-air using ultrasound will become an integral part of our daily lives.
‘You stop having to learn how to use every single different device and you start being able to just know instinctively how to use them,’ he said.
One early device using the technology could be an alarm clock which senses gestures and gives feedback to show that you have snoozed it or turned off the alarm. It could also make a difference in our kitchens, where people often have dirty hands and would want to be able to interact with appliances without having to touch them.
‘You just throw your hand in the general direction of your cooker hob, say, and you can gesture to change it,’ said Carter. ‘Or you throw your hand in the direction of your digital radio that’s playing music, you can do a quick gesture to turn it down.’
The technology was made possible due to the accuracy of modern motion-sensing technology such as Microsoft Kinect, combined with the computing power to manipulate ultrasound speakers in clever ways.
The difference is that with motion-sensing technology alone, you don’t know if your gesture has achieved the desired result without looking, whereas the haptic feedback device can let you feel something at the same time.
It works using often tens or hundreds of small speakers which operate at 40 000 hertz, too high a frequency for us to hear. Human hearing typically ranges from 20 hertz to
20 000 hertz.
Blowing through a straw
Our hands can’t feel sounds in the 40 000 hertz frequency, so what the team did was turn them on and off to create a second vibration at between 1 to 500 hertz – and that makes your skin move at speeds you can feel, giving you a sense of pressure a bit like someone blowing through a straw onto your skin.
‘What we needed to do was to figure out how to turn them on and off, and in what time delay so that you create the tactile sensations you want,’ said Professor Sriram Subramanian, from University of Sussex, who set the Ultrahaptics company up with Tom Carter and a third researcher, Dr Ben Long.
‘You stop having to learn how to use every single different device.’
Tom Carter, Co-founder, Ultrahaptics
The downside is that 1 to 500 hertz is within human hearing range, meaning the technology gave off an annoying buzz. Prof. Subramanian led the DHaptics project, funded by the EU's European Research Council, to find a way to turn the volume down on that noise, and he’s been successful.
Now that the technology is market-ready, Carter at Ultrahaptics travels all over the world speaking to big manufacturers about how they could add the technology to car dashboards, domestic appliances and consumer electronics devices in a way that is tailored to their brand identity.
‘There are a lot of companies who have buttons and dials today, where that dial feels like that company’s dial and that’s just considered part of their brand image,’ said Carter. ‘So we are able to try and recreate that so that, even when it’s touchless, it still feels like that company’s product.’
In fact Ultrahaptics, which spun out of a university about a year and a half ago, is so busy dealing with carmakers and appliance companies that they’re having to turn people away.
However, the fact that they are busy doesn’t mean smaller manufacturers can’t also get in on the act. Ultrahaptics plan to package the technology into a chip and software combination that means people can start developing their own ultrasound-based haptic devices.
That development was only possible thanks to the EU’s specialised funding for small, highly innovative firms under Horizon 2020, the EU’s research funding scheme, as part of the UTOUCH project.
‘We’ve got a growth period coming now because of this Horizon 2020 programme,’ said Carter. ‘That’s really unlocked a really big project that wasn’t going to be possible.’
Haptics lets users control objects with invisible buttons floating in mid-air. Video courtesy of Ultrahaptics
The chip and software package means the company will be able to get more products onto the market as it only requires one Ultrahaptics staff member to work with companies to help them develop a device.
In fact, they expect the first might be on sale in time for Christmas 2016.
The next step is to work on ways to refine the technology, and Carter believes the real excitement lies within virtual reality, with an ultrasound-based haptics device being used alongside a virtual reality headset such as Oculus Rift.
‘With computer games, the thing I’m personally most excited about is virtual reality,’ he said. ‘If you can go into a virtual world, be able to reach out and feel and touch things that are in the virtual world but obviously aren’t really there in the real world, I think that would be a really exciting experience.’
Under the Horizon 2020 research funding programme, the EU can support high-tech small- and medium-sized enterprises (SMEs).
Around EUR 3 billion in funds has been earmarked for SMEs which are based in the EU or associated countries.
The funding is designed to help support the development of innovative products or services which are close to market.
For more information https://ec.europa.eu/programmes/horizon2020/en/h2020-section/sme-instrument
Concrete has become our building material of choice for countless structures such as bridges, towers and dams. But it also has a huge environmental footprint mostly due to carbon dioxide emissions from the production of cement – one of its main constituents. Researchers are now experimenting with root vegetables and recycled plastic in concrete to see whether this can make it stronger – and more sustainable – and even power streetlights or air pollution sensors.
Retrofitting Europe’s buildings for energy efficiency is not enough to slash the carbon footprint of the construction sector and cut emissions in time to meet the Paris climate agreement goals, according to Dr Catherine De Wolf, assistant professor of design and construction management at TU Delft in the Netherlands.
Artificial intelligence (AI) used by governments and the corporate sector to detect and extinguish online extreme speech often misses important cultural nuance, but bringing in independent factcheckers as intermediaries could help step up the fight against online vitriol, according to Sahana Udupa, professor of media anthropology at Ludwig Maximilian University of Munich, Germany.
In the summer of 2014 a strange building began to take shape just outside MoMA PS1, a contemporary art centre in New York City. It looked like someone had started building an igloo and then got carried away, so that the ice-white bricks rose into huge towers. It was a captivating sight, but the truly impressive thing about this building was not so much its looks but the fact that it had been grown.
Independent factcheckers can bring context to AI tools, says media anthropologist.
Live mycelium networks, capable of information processing, could be used as building materials.
Dr Kate Rychert studies ocean plate structures.