Link to original article

Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: IRL in General Environments, published by michaelcohen on March 9, 2023 on The AI Alignment Forum.Here is a proposal for Inverse Reinforcement Learning in General Environments. (2 1/2 pages; very little math).Copying the introduction here:The eventual aim of IRL is to understand human goals. However, typical algorithms for IRL assume the environment is finite-state Markov, and it is often left unspecified how raw observational data would be converted into a record of human actions, alongside the space of actions available. For IRL to learn human goals, the AI has to consider general environments, and it has to have a way of identifying human actions. Lest these extensions appear trivial, I consider one of the simplest proposals, and discuss some difficulties that might arise.Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.