Robot-assisted language assessment: development and evaluation of feasibility and usability

Authors
Seok, SukyungChoi, SujinKim, KimunChoi, JongsukSung, Jee EunLim, Yoonseob
Issue Date
2024-01
Publisher
Springer Verlag
Citation
Intelligent Service Robotics
Abstract
Many studies have shown that robots can provide medical help to patients, such as supporting physical movements, managing mood, or simulating cognitive function. However, robotic cognitive/language assessment, which is vital for mental health care, has not been fully explored and is limited to only a few types of assessment. The aim of this study is to present and evaluate a social robot equipped with a web-based language assessment for sentence comprehension test (SCT) with a dialogue system involving yes/no questions. A total of 50 participants took the test with 36 items conducted by a robot (robot-SCT), while a total of 55 participants took the same test but conducted by a human examiner (human-SCT). Comparative analyses were performed to evaluate the validity of the robot-SCT in terms of test scores and time-related measures. Usability was evaluated through the system usability score and interview feedback. With regard to the validity of the robot-SCT, the test scores indicated no significant differences between the robot-SCT and human-SCT. In addition, conditional differences in reaction time for the test items were observed, similar to the previous paper-and-pencil researches. The high system usability scores (i.e., mean = 78.5, SD = 11) demonstrated the high usability of the robot-SCT. This study demonstrates the validity and usability of robotic language assessment among normal adults. However, further evaluation is required for people with dementia or mild cognitive impairment.
Keywords
MONTREAL COGNITIVE ASSESSMENT; DEMENTIA; MOCA; MEMORY; ADULTS; Sentence comprehension test (SCT); Robotic cognitive/language assessment; Service robotics; Human-robot interaction (HRI)
ISSN
1861-2776
URI
https://pubs.kist.re.kr/handle/201004/148592
DOI
10.1007/s11370-023-00505-2
Appears in Collections:
KIST Article > 2024
Files in This Item:
There are no files associated with this item.
Export
RIS (EndNote)
XLS (Excel)
XML

qrcode

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

BROWSE