This study is led by Dr. Claudio FERRARI (Department of Engineering and Architecture, University of Parma, Italy), and Prof. Stefano BERRETTI, Prof. Pietro PALA, and Prof. Alberto Del BIMBO (Department of Information Engineering, University of Florence, Italy). This paves the way for the use of the proposed tool in remote medical rehabilitation monitoring.
The work described in the manuscript introduces the following innovations:
• An automatic method to estimate local and asymmetric face deformations from a set of 2D landmarks extracted from a video sequence.
• A two-step fitting process based on a sparse 3D Morphable Face Model (3DMM) is proposed to disentangle muscular movements from shape changes due to different identities.
• The 3DMM employed allows to accurately identify and measure asymmetries when performing facial actions.
• Application to face rehabilitation: patients recovering from facial paralysis can monitor the progress of their rehabilitation without the need of specialized equipment. The user can measure how accurately he/she can reproduce some facial actions, evaluating possible intensity deficiency.
• Immediate feedback to the subject.
Reference:
Claudio FERRARI, Stefano BERRETTI, Pietro PALA, Alberto Del BIMBO. Measuring 3D face deformations from RGB images of expression rehabilitation exercises. Virtual Reality & Intelligent Hardware, 2022, 4(4): 306–323 doi: 10.1016/j.vrih.2022.05.004
Virtual Reality
Measuring 3D face deformations from RGB images of expression rehabilitation exercises
9-Sep-2022