Skip to main content

Search

Items tagged with: MoralCrumpleZone

Thanks for this. I don't recall hearing the phrase "moral crumple zone". This perfectly encapsulates what I was thinking, the idea that the human is placed sacrificially to protect the system (AI software, business, senior management) from being held accountable.

#MoralCrumpleZone

The highlighted text in this screenshot reads: "Just as the crumple zone in a car is designed to absorb the force of impact in a crash, the human in a highly complex and automated system may become simply a component—accidentally or intentionally—that bears the brunt of the moral and legal responsibilities when the overall system malfunctions. While the crumple zone in a car is meant to protect the human driver, the moral crumple zone protects the integrity of the technological system, at the expense of the nearest human operator." source: "Moral Crumple Zones: Cautionary Tales in Human-Robot Interaction", by Madeleine Clare Elish, Engaging Science, Technology, and Society, DATA & SOCIETY RESEARCH INSTITUTE, 23 Mar 2019 https://estsjournal.org/index.php/ests/article/view/260 http://orcid.org/0000-0002-9647-1178 DOI: https://doi.org/10.17351/ests2019.260
#moralcrumplezone

⇧