Orca is a 13B parameter model that learns to imitate the reasoning processes of LFMs. It uses progressive learning and teacher assistance from ChatGPT to overcome capacity gaps. By leveraging rich signals from GPT-4, Orca enhances its capabilities and improves imitation learning performance.