Judging One's Own or Another Person's Responsibility in Interactions With Automation. 2022

Nir Douer, and Joachim Meyer
26745 Tel Aviv University, Israel.

We explore users' and observers' subjective assessments of human and automation capabilities and human causal responsibility for outcomes. In intelligent systems and advanced automation, human responsibility for outcomes becomes equivocal, as do subjective perceptions of responsibility. In particular, actors who actively work with a system may perceive responsibility differently from observers. In a laboratory experiment with pairs of participants, one participant (the "actor") performed a decision task, aided by an automated system, and the other (the "observer") passively observed the actor. We compared the perceptions of responsibility between the two roles when interacting with two systems with different capabilities. Actors' behavior matched the theoretical predictions, and actors and observers assessed the system and human capabilities and the comparative human responsibility similarly. However, actors tended to relate adverse outcomes more to system characteristics than to their own limitations, whereas the observers insufficiently considered system capabilities when evaluating the actors' comparative responsibility. When intelligent systems greatly exceed human capabilities, users may correctly feel they contribute little to system performance. They may interfere more than necessary, impairing the overall performance. Outside observers, such as managers, may overweigh users' contribution to outcomes, holding users responsible for adverse outcomes when they rightly trusted the system. Presenting users of intelligent systems and others with performance measures and the comparative human responsibility may help them calibrate subjective assessments of performance, reducing users' and outside observers' biases and attribution errors.

UI MeSH Term Description Entries
D004644 Emotions Those affective states which can be experienced and have arousing and motivational properties. Feelings,Regret,Emotion,Feeling,Regrets
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D001331 Automation Controlled operation of an apparatus, process, or system by mechanical or electronic devices that take the place of human organs of observation, effort, and decision. (From Webster's Collegiate Dictionary, 1993) Automations
D012919 Social Behavior Any behavior caused by or affecting another individual or group usually of the same species. Sociality,Behavior, Social,Behaviors, Social,Social Behaviors
D012938 Social Perception The perceiving of attributes, characteristics, and behaviors of one's associates or social groups. Perception, Social,Perceptions, Social,Social Perceptions

Related Publications

Nir Douer, and Joachim Meyer
October 1997, Sygeplejersken,
Nir Douer, and Joachim Meyer
November 1997, Sygeplejersken,
Nir Douer, and Joachim Meyer
October 1961, Veska,
Nir Douer, and Joachim Meyer
January 1984, Archives belges = Belgisch archief,
Nir Douer, and Joachim Meyer
January 1986, Family medicine,
Nir Douer, and Joachim Meyer
March 2004, Current biology : CB,
Nir Douer, and Joachim Meyer
August 1986, Krankenpflege. Soins infirmiers,
Nir Douer, and Joachim Meyer
January 1989, Kurinikaru sutadi = Clinical study,
Nir Douer, and Joachim Meyer
January 2002, Tidsskrift for den Norske laegeforening : tidsskrift for praktisk medicin, ny raekke,
Nir Douer, and Joachim Meyer
January 1993, L'Infirmiere du Quebec : revue officielle de l'Ordre des infirmieres et infirmiers du Quebec,
Copied contents to your clipboard!