Facial recognition used to monitor patient safety

Author: Jo Carlowe
Facial recognition used to monitor patient safety

Facial recognition technology could be used to predict risky behaviour by patients in intensive care units.

A team of Japanese scientists has used facial recognition technology to develop an automated system that can predict unsafe behaviour such as patients accidentally removing their breathing tube.

The new research*, presented at this year's Euroanaesthesia congress (the annual meeting of the European Society of Anaesthesiology) in Vienna, suggests that the automated risk detection tool has the potential as a continuous monitor of patient's safety and could remove some of the limitations associated with limited staff capacity that make it difficult to continuously observe critically-ill patients at the bedside.

"Using images we had taken of a patient's face and eyes we were able to train computer systems to recognise high-risk arm movement", says Dr Akane Sato from Yokohama City University Hospital, Japan, who led the research. "We were surprised about the high degree of accuracy that we achieved, which shows that this new technology has the potential to be a useful tool for improving patient safety, and is the first step for a smart ICU which is planned in our hospital.”

The study included 24 postoperative patients (average age 67 years) who were admitted to ICU in Yokohama City University Hospital between June and October 2018. The automated systems predicted high risk unsafe behaviour with 75% accuracy.

The proof-of-concept model was created using pictures taken by a camera mounted on the ceiling above patients' beds. Around 300 hours of data were analysed to find daytime images of patients facing the camera in a good body position that showed their face and eyes clearly.

In total, 99 images were subject to machine learning - an algorithm that can analyse specific images based on input data, in a process that resembles the way a human brain learns new information.

"Various situations can put patients at risk, so our next step is to include additional high-risk situations in our analysis, and to develop an alert function to warn healthcare professionals of risky behaviour. Our end goal is to combine various sensing data such as vital signs with our images to develop a fully automated risk prediction system", says Dr Sato.

The authors note several limitations including that more images of patients in different positions are needed to improve the generalisability of the tool in real life. They also note that monitoring of the patient's consciousness may improve the accuracy in distinguishing between high-risk behaviour and voluntary movement.

*Sato A, Takaki S, Yokose M, et al. Automatic prediction model with facial recognition and machine learning of patient’s image in ICU patients. Abstract 3784. Presented at the Euroanaesthesia congress 2019, 3 June 2019