Measuring Transparency in Intelligent Robots

Embodied AI and Robotics RP AI Safety / AI Ethics TRA
2024年08月29日
随着机器人越来越多地融入我们的日常生活中,使它们变得透明的需求变得前所未有的重要。然而,尽管透明度在人机交互中非常重要,但直到现在,缺乏一种标准化的机器人透明度度量方法。本文通过提出第一个综合性的机器人系统中感知透明度的量表来填补这一空白,该量表提供英语、德语和意大利语版本。我们的方法将透明度概念化为一个多维结构,包括可解释性、易读性、可预测性和元理解。所提出的量表是一个经过严格的三阶段过程开发出来的产品,共有1,223名参与者。首先,我们生成了量表项目,其次,我们进行了探索性因子分析,第三,确认性因子分析用于验证新开发的TOROS量表的因子结构。最终的量表包括26个项目,包括三个因子:易读性、可解释性和可预测性。TOROS在三个跨国样本中表现出高的跨语言可靠性、因子间相关性、模型拟合度、内部一致性和收敛效度。这个经过实证验证的工具使得机器人透明度的评估成为可能,并有助于理解这个复杂的概念。通过提供一个标准化的度量方法,我们促进了人机交互中一致且可比较的研究,其中TOROS可以作为一个基准。
As robots become increasingly integrated into our daily lives, the need to make them transparent has never been more critical. Yet, despite its importance in human-robot interaction, a standardized measure of robot transparency has been missing until now. This paper addresses this gap by presenting the first comprehensive scale to measure perceived transparency in robotic systems, available in English, German, and Italian languages. Our approach conceptualizes transparency as a multidimensional construct, encompassing explainability, legibility, predictability, and meta-understanding. The proposed scale was a product of a rigorous three-stage process involving 1,223 participants. Firstly, we generated the items of our scale, secondly, we conducted an exploratory factor analysis, and thirdly, a confirmatory factor analysis served to validate the factor structure of the newly developed TOROS scale. The final scale encompasses 26 items and comprises three factors: Illegibility, Explainability, and Predictability. TOROS demonstrates high cross-linguistic reliability, inter-factor correlation, model fit, internal consistency, and convergent validity across the three cross-national samples. This empirically validated tool enables the assessment of robot transparency and contributes to the theoretical understanding of this complex construct. By offering a standardized measure, we facilitate consistent and comparable research in human-robot interaction in which TOROS can serve as a benchmark.
许愿