acoustic-to-articulatory inversion

ArtBoost: Synthetic Data Augmentation Boosts Acoustic-to-Articulatory Inversion with Limited Real Data

A new data augmentation strategy called ArtBoost leverages large-scale speech-mesh datasets from 3D facial animation to improve acoustic-to-articulatory inversion (AAI) models under limited EMA supervision. The method extracts pseudo articulatory trajectories from facial anchors and pre-trains models before fine-tuning on real data, yielding consistent gains in PCC and RMSE across architectures.