FRAILWATCH: Sistema de Monitorización Robótico de la Fragilidad para Personas Mayores

FRAILWATCH is a research project funded by the 2023 Call for Research and Innovation Projects of Barcelona City Council and La Caixa Foundation (Project 23S06141-001). The project aims to promote the study of innovative social robotic capabilities with significant potential in the medical field. My contribution focused on developing a 3D monocular human action recognition benchmark for frailty assessment in elderly patients. I explored and evaluated multiple 3D reconstruction methods including direct methods, 2D-3D lifting approaches, and SMPL for human pose estimation. To validate the methods, I recorded a comprehensive test dataset using an Optitrack motion capture system, providing ground truth data for evaluation. I trained multiple models specifically designed for frail tests and integrated algorithms for assessing various frailty indicators including balance, gaiting speed, and other mobility metrics, which includes solving the scale ambiguity and recover the trajectory in the world space. The work also included comprehensive performance evaluation and comparison with stereo-based solutions, showing the effectiveness and limitation of using monocular methods.

View Project