Understanding older people’s voice interactions with smart voice assistants: a new modified rule-based natural language processing model with human input

Authors

Zhengxu Yan, University of California-Berkeley
Victoria Dube, University of Nebraska-Omaha
Judith Heselton, University of Nebraska-Omaha
Kate Johnson, University of Nebraska-Lincoln
Changmin Yan, University of Nebraska - LincolnFollow
Valerie Jones, University of Nebraska-LincolnFollow
Julie Blaskewicz Boron, University of Nebraska at OmahaFollow
Marcia Shade, University of Nebraska Medical CenterFollow

Document Type

Article

Date of this Version

5-14-2024

Citation

Yan Z, Dube V, Heselton J, Johnson K, Yan C, Jones V, Blaskewicz Boron J and Shade M (2024) Understanding older people’s voice interactions with smart voice assistants: a new modified rule-based natural language processing model with human input. Front. Digit. Health 6:1329910. doi: 10.3389/fdgth.2024.1329910

Comments

Open access.

Abstract

The COVID-19 pandemic has expedited the integration of Smart Voice Assistants (SVA) among older people. The qualitative data derived from user commands on SVA is pivotal for elucidating the engagement patterns of older individuals with such systems. However, the sheer volume of user-generated voice interaction data presents a formidable challenge for manual coding. Compounding this issue, age-related cognitive decline and alterations in speech patterns further complicate the interpretation of older users’ SVA voice interactions. Conventional dictionary-based textual analysis tools, which count word frequencies, are inadequate in capturing the evolving and communicative essence of these interactions that unfold over a series of dialogues and modify with time. To address these challenges, our study introduces a novel, modified rule-based Natural Language Processing (MR-NLP) model augmented with human input. This reproducible approach capitalizes on human-derived insights to establish a lexicon of critical keywords and to formulate rules for the iterative refinement of the NLP model. English speakers, aged 50 or older and residing alone, were enlisted to engage with Amazon Alexa^TM via predefined daily routines for a minimum of 30 min daily spanning three months (N = 35, mean age = 77). We amassed time-stamped, textual data comprising participants’ user commands and responses from Alexa^TM. Initially, a subset constituting 20% of the data (1,020 instances) underwent manual coding by human coder, predicated on keywords and commands. Separately, a rule-based Natural Language Processing (NLP) methodology was employed to code the identical subset. Discrepancies arising between human coder and the NLP model programmer were deliberated upon and reconciled to refine the rule-based NLP coding framework for the entire dataset. The modified rule-based NLP approach demonstrated notable enhancements in efficiency and scalability and reduced susceptibility to inadvertent errors in comparison to manual coding. Furthermore, human input was instrumental in augmenting the NLP model, yielding insights germane to the aging adult demographic, such as recurring speech patterns or ambiguities. By disseminating this innovative software solution to the scientific community, we endeavor to advance research and innovation in NLP model formulation, subsequently contributing to the understanding of older people’s interactions with SVA and other AIpowered systems.