Deriving static representations from contextual ones, interdisciplinary research, training large models, the Foundation Models paper and CRFM, being an academic on Twitter, and progress in NLP.

Transcript: https://web.stanford.edu/class/cs224u/podcast/bommasani/

• Rishi's website
• Rishi on Twitter
• Bommasani et al 2020
• On the opportunities and risks of foundation models
• Reflections on foundation models
• EleutherAI
• Chinchilla
• http://www.isattentionallyouneed.com
• Rishi on The Gradient podcast