Podcast: Papers Read on AI
Episode: LLaMA: Open and Efficient Foundation Language Models
Pub date: 2023-03-10

We introduce LLaMA, a collection of foundation language models ranging from 7B to 65B parameters. We train our models on trillions of tokens, and show that it is possible to train state-of-the-art models using publicly available datasets exclusively, without resorting to proprietary and inaccessible datasets. In particular, LLaMA-13B outperforms GPT-3 (175B) on most benchmarks, and LLaMA-65B is competitive with the best models, Chinchilla-70B and PaLM-540B. We release all our models to the research community.2023: Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aur'elien Rodriguez, Armand Joulin, Edouard Grave, Guillaume LampleRanked #1 on Question Answering on PIQAhttps://arxiv.org/pdf/2302.13971v1.pdf

The podcast and artwork embedded on this page are from Rob, which is the property of its owner and not affiliated with or endorsed by Listen Notes, Inc.