The ubiquity of CCTV cameras makes it easy to track down criminal suspects – unless they’re wearing a disguise. But even that wouldn’t fool the latest software, which can recognise people based on their anatomy or on the way they walk.
‘Police often have high-quality records of suspects that are hiding their face,’ said Radek Štourač, a computer scientist and owner of the software company Kinalisoft in Brno, Czech Republic. ‘Our system can help recognise such people and trace them as they move in front of cameras.’
Štourač and colleagues’ software for the analysis of gait – that is, the particular way someone walks – has been developed with backing from the European Union. It involves taking a video and separating a human silhouette from the background – a tricky process, as backgrounds themselves often contain all sorts of colourful moving objects.
Having got the silhouette, the software extracts certain data based on the subject’s anatomy – hip and knee joints, for example – to characterise the way they move. Characterising a gait is like taking a fingerprint – once you’ve matched it to a subject, you can identify the subject again based on that information alone.
And like a fingerprint, a gait is unique. Trying to cheat – by faking a limp, for example – generally doesn’t work.
Štourač’s software has just a 0.8 % chance of mistaking a person for someone else when they are walking normally and, remarkably, can perform its characterisation based on just four steps. ‘No additional sensors or cameras,’ said Štourač. ‘Nothing.’
‘Police often have records of suspects hiding their face. Our system can help recognise such people.’
Radek Štourač, Kinalisoft Ltd, Czech Republic
Of course, even a short segment of clear video may be too much to ask in some situations. As computer scientist Professor Christophoros Nikou of the University of Ioannina, Greece, points out, surveillance data often consists of just a single image from behind, an image with the face missing, or an image that is simply very fuzzy.
Prof. Nikou is leading another EU project, called StillNoFace, which is funded under the Marie Skłodowska-Curie scheme and is attempting to perform subject recognition under just these sorts of conditions. The idea is to take a still image, and to identify what three-dimensional pose the subject is in.
This pose allows the software to work out the geometry of the person’s basic anatomy, without getting confused by their orientation in the photo. Based on this geometry, as in the gait analysis, the software can then characterise the subject.
That’s the theory, anyway. Prof. Nikou and colleagues are still in the early stages of development, and have an initial goal of merely working out the sex of a photographed subject based on his or her geometry. ‘We can’t report any results now, but we’ll have a preliminary evaluation of our algorithm in one to two months,’ Prof. Nikou said.
The software being developed by Štourač, Prof. Nikou and others has obvious applications in security, by helping to track criminal suspects or monitor restricted areas, for example. As with any new form of surveillance, however, it also raises the question of human liberty, and whether people want to be identified so easily wherever they go.
‘Compromising freedom of individuals is a very serious issue, and it is very dangerous to ease the legislation there,’ said Štourač. ‘On the other hand, we are living in dangerous times and feeling safe in everyday life is also very important.’
But Prof. Nikou points out that applications may go beyond security, to areas where few would have any unease. ‘Other applications may be envisaged such as the detection in a street video of a person suffering from Alzheimer’s disease, who cannot find the way home and is being sought by his relatives,’ he said.
The world’s pressing need is a vaccine to fight the current threat of Covid-19, but ultimately we may be able to develop a pan-coronavirus vaccine, Sunetra Gupta, a professor of theoretical epidemiology at the University of Oxford, UK, said at the European Commission’s annual research event.
Aggressive tiger mosquitoes capable of spreading debilitating tropical diseases such as dengue and Zika are spreading through Europe, but scientists hope it may be possible to control these biting pests with a form of insect birth control and drones.
Leuven, Belgium, has been named the 2020 European Capital of Innovation for its use of innovation to improve residents’ lives.
Recent advances are bringing cancer vaccines much closer to reality, giving patients another weapon in their arsenal of cancer treatments, according to Dr Madiha Derouazi, CEO of Amal Therapeutics and one of three winners of the 2020 EU Prize for Women Innovators.
'Frontier research' scientists share how they are fighting Covid-19.
The Belgian city won the €1 million iCapital cash prize, while runner-up prizes went to Cluj-Napoca, Espoo, Helsingborg, Vienna and Valencia.
Dr Kate Rychert studies ocean plate structures.