Thursday, November 21, 2024, 5pm

This thesis explores diverse decision-making strategies for autonomous agents by examining knowledge-dependent and data-dependent approaches in stationary and dynamic data environments. We address five core research problems across three thematic areas: knowledge-dependent, stationary data-dependent, and evolving data-dependent decision-making.

We first investigate knowledge-driven decision-making within robotic swarms, characterizing vulnerabilities in systems governed by consistent rule-following behaviors. Here, adversarial agents exploit predictable patterns in swarm actions, demonstrating the risks inherent in structured decision protocols.

The second theme shifts to stationary data, where we leverage expert demonstrations to inform decision-making. Two studies illustrate this: one develops socially intelligent robotic interactions through imitation learning, while the other unifies multiple methods of reward parameter estimation in expert policies under a common optimization framework. Together, these studies highlight how structured, stable examples can enhance model precision and generalization in social and reward-driven contexts.

The final focus is on continual learning to mitigate catastrophic forgetting in dynamic environments. We propose methods for incremental object detection, first by incorporating new object classes in images without destabilizing existing knowledge, and then extending this framework to videos in a domain-incremental setting. By leveraging temporal context, this approach aims to support models capable of adapting to varied, evolving environments, crucial for applications like autonomous driving and surveillance.

Thesis Committee
Kris Kitani (Chair)
Maxim Likhachev
Deva Ramanan
Hironobu Fujiyoshi (Chubu University)

Additional Information

In Person and Zoom Participation. See announcement.

Event Type: Thesis Proposals
Room Number: In Person and Virtual - ET
Building: Newell-Simon 3001
Speaker's Name: NAVYATA N. SANGHVI
Speaker Website: www.ri.cmu.edu…
Speaker's Professional Title: Ph.D. Student, Robotics Institute, Carnegie Mellon University
Talk Title: Knowledge and Data Dependence in Decision-Making
For More Information: lyonsmuth@cmu.edu
Affiliations: Robotics Institute (RI)
Organization(s): School of Computer Science
Event Website Title: Event Website
Event Website URL: www.ri.cmu.edu…