At the Georgia Institute of Technology, computer scientists are exploring an unconventional tool to instill moral reasoning in machines: the timeless art of storytelling. Mark Riedl and Brent Harrison, researchers in the School of Interactive Computing, have developed a method called Quixote that trains artificial intelligence agents to recognize and adopt socially acceptable behavior by learning from narratives. Their work addresses a core challenge in AI—ensuring that autonomous systems act in ways that align with human values.
The premise rests on the idea that stories, from fables to novels, encode the unwritten rules of a culture. As Riedl explains, these collected tales teach children how to behave in socially acceptable ways, offering examples of proper and improper conduct. The team believes that if robots can comprehend stories, they can similarly absorb these norms, potentially reducing erratic or harmful behavior while still achieving their intended objectives.
Quixote builds on a previous system called Scheherazade, also developed by Riedl, which demonstrated how AI could gather correct sequences of actions by crowdsourcing plot structures from the internet. In their paper, Riedl and Harrison outline how Scheherazade first establishes a baseline of what constitutes a normal or correct plot graph. This graph is then fed into Quixote, which translates it into a reward signal—a mechanism that reinforces certain behaviors and discourages others during trial-and-error learning.
To illustrate, the researchers describe a hypothetical robot tasked with picking up over-the-counter medication as quickly as possible. Without value alignment, the robot might simply grab the medicine and leave without paying, ignoring social conventions. But with Quixote's positive reinforcement, the robot learns to wait in line or interact politely with the pharmacist, behaviors that are rewarded as socially appropriate.
From Simple Tasks to Broader Moral Reasoning
Quixote is currently best suited for robots with a limited purpose that still require human interaction to achieve their goals. It can map out potential unethical actions an agent might take, allowing researchers to adjust the system accordingly. While it is a primitive first step, the approach could pave the way toward more general moral reasoning in AI.
Riedl emphasizes that AI must be "enculturated" to adopt the values of a particular society. By giving robots the ability to read and understand stories, they may learn to avoid unacceptable behavior even without a comprehensive human user manual. This narrative-based training could become a practical pathway for embedding ethics into machines, addressing a growing concern as AI becomes more integrated into daily life.
Comments
Sign in to leave a comment
No account? Create one
No comments yet.