Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 3 of 3
Full-Text Articles in Medicine and Health Sciences
Parallel Reference Speaker Weighting For Kinematic-Independent Acoustic-To-Articulatory Inversion, An Ji, Michael T. Johnson, Jeffrey J. Berry
Parallel Reference Speaker Weighting For Kinematic-Independent Acoustic-To-Articulatory Inversion, An Ji, Michael T. Johnson, Jeffrey J. Berry
Speech Pathology and Audiology Faculty Research and Publications
Acoustic-to-articulatory inversion, the estimation of articulatory kinematics from an acoustic waveform, is a challenging but important problem. Accurate estimation of articulatory movements has the potential for significant impact on our understanding of speech production, on our capacity to assess and treat pathologies in a clinical setting, and on speech technologies such as computer aided pronunciation assessment and audio-video synthesis. However, because of the complex and speaker-specific relationship between articulation and acoustics, existing approaches for inversion do not generalize well across speakers. As acquiring speaker-specific kinematic data for training is not feasible in many practical applications, this remains an important and …
Vowel Production In Mandarin Accented English And American English: Kinematic And Acoustic Data From The Marquette University Mandarin Accented English Corpus, An Ji, Jeffrey J. Berry, Michael T. Johnson
Vowel Production In Mandarin Accented English And American English: Kinematic And Acoustic Data From The Marquette University Mandarin Accented English Corpus, An Ji, Jeffrey J. Berry, Michael T. Johnson
Speech Pathology and Audiology Faculty Research and Publications
Few electromagnetic articulography (EMA) datasets are publicly available, and none have focused systematically on non-native accented speech. We introduce a kinematic-acoustic database of speech from 40 (gender and dialect balanced) participants producing upper-Midwestern American English (AE) L1 or Mandarin Accented English (MAE) L2 (Beijing or Shanghai dialect base). The Marquette University EMA-MAE corpus will be released publicly to help advance research in areas such as pronunciation modeling, acoustic-articulatory inversion, L1-L2 comparisons, pronunciation error detection, and accent modification training. EMA data were collected at a 400 Hz sampling rate with synchronous audio using the NDI Wave System. Articulatory sensors were placed …
Tracking Articulator Movements Using Orientation Measurements, An Ji, Michael T. Johnson, Jeffrey J. Berry
Tracking Articulator Movements Using Orientation Measurements, An Ji, Michael T. Johnson, Jeffrey J. Berry
Speech Pathology and Audiology Faculty Research and Publications
This paper introduces a new method to track articulator movements, specifically jaw position and angle, using 5 degree of freedom (5 DOF) orientation data. The approach uses a quaternion rotation method to accomplish this jaw tracking during speech using a single senor on the mandibular incisor. Data were collected using the NDI Wave Speech Research System for one pilot subject with various speech tasks. The degree of jaw rotation from the proposed approach is compared with traditional geometric calculation. Results show that the quaternion based method is able to describe jaw angle trajectory and gives more accurate and smooth estimation …