Dynamics of plosive consonants via imaging, computations, and soft electronics

Abstract

A quantitative understanding of the coupled dynamics of flow and particles in aerosol and droplet transmission associated with speech remains elusive. Here, we summarize an effort that integrates insights into flow-particle dynamics induced by the production plosive sounds during speech with skin-integrated electronic systems for monitoring the production of these sounds. In particular, we uncover diffusive and ballistic regimes separated by a threshold particle size and characterize the Lagrangian acceleration and pair dispersion. Lagrangian dynamics of the particles in the diffusive regime exhibit features of isotropic turbulence. These fundamental findings highlight the value in skin-interfaced wireless sensors for continuously measuring critical speech patterns in clinical settings, work environments, and the home, based on unique neck biomechanics associated with the generation of plosive sounds. We introduce a wireless, soft device that captures these motions to enable detection of plosive sounds in multiple languages through a convolutional neural network approach. This work spans fundamental flow-particle physics to soft electronic technology, with implications in monitoring and studying critical speech patterns associated with aerosol and droplet transmissions relevant to the spread of infectious diseases.