Link to original article

Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Research request (alignment strategy): Deep dive on "making AI solve alignment for us", published by JanBrauner on December 1, 2022 on The AI Alignment Forum.We might be able to train AI alignment assistants that massively accelerate/improve the alignment research that gets done. These assistants need not have (strongly) superhuman capabilities or be highly agentic, they just need to be capable and aligned enough to allow us to offload most work on alignment, safety, and related problems to them.This seems to be a key part of OpenAI's alignment strategy. The best explanation of this strategy that I've seen is maybe A minimal viable product for alignment, with an excellent discussion in the comment section.If this strategy is promising, it likely recommends fairly different prioritisation from what the alignment community is currently doing (see, e.g. Beth Barnes's ideas here, or my upcoming post on "non-scalable oversight"---i.e. pragmatic improvements to oversight that would help with training alignment assistant but which cannot directly scale to oversight of superhuman systems).I haven't seen any deep treatment of the viability of this strategy and its implications. I think such an analysis would be pretty useful.I could potentially provide funding for such an analysis or help with obtaining funding.Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.