Evaluating Older Adults’ Engagement and Usability With AI-Driven Interventions: Randomized Pilot Study

Background: Technologies that serve as assistants are growing more popular for entertainment and aiding in daily tasks. Artificial intelligence (AI) in these technologies could also be helpful to deliver interventions that assist older adults with symptoms or self-management. Personality traits may play a role in how older adults engage with AI technologies. To ensure the best intervention delivery, we must understand older adults’ engagement with and usability of AI-driven technologies. Objective: This study aimed to describe how older adults engaged with routines facilitated by a conversational AI assistant. Methods: A randomized pilot trial was conducted for 12-weeks in adults aged 60 years or older, self-reported living alone, and having chronic musculoskeletal pain. Participants (N=50) were randomly assigned to 1 of 2 intervention groups (standard vs enhanced) to engage with routines delivered by the AI assistant Alexa (Amazon). Participants were encouraged to interact with prescribed routines twice daily (morning and evening) and as needed. Data were collected and analyzed on routine engagement characteristics and perceived usability of the AI assistant. An analysis of the participants’ personality traits was conducted to describe how personality may impact engagement and usability of AI technologies as interventions. Results: The participants had a mean age of 79 years, with moderate to high levels of comfort and trust in technology, and were predominately White (48/50, 96%) and women (44/50, 88%). In both intervention groups, morning routines (n=62, 74%) were initiated more frequently than evening routines (n=52, 62%; z=−2.81, P=.005). Older adult participants in the enhanced group self-reported routine usability as good (mean 74.50, SD 11.90), and those in the standard group reported lower but acceptable usability scores (mean 66.29, SD 6.94). Higher extraversion personality trait scores predicted higher rates of routine initiation throughout the whole day and morning in both groups (standard day: B=0.47, P=.004; enhanced day: B=0.44, P=.045; standard morning: B=0.50, P=.03; enhanced morning: B=0.53, P=.02). Higher agreeableness (standard: B=0.50, P=.02; enhanced B=0.46, P=.002) and higher conscientiousness (standard: B=0.33, P=.04; enhanced: B=0.38, P=.006) personality trait scores predicted better usability scores in both groups. Conclusions: he prescribed interactive routines delivered by an AI assistant were feasible to use as interventions with older adults. Engagement and usability by older adults may be influenced by personality traits such as extraversion, agreeableness, and conscientiousness. While integrating AI-driven interventions into health care, it is important to consider these factors to promote positive outcomes.