GPT-3
175-billion-parameter language model that demonstrated strong text generation and reasoning across many tasks with minimal fine-tuning.
1 milestone
OpenAI released GPT-3 via private beta API
In May–June 2020, OpenAI published the GPT-3 language model in a paper by Tom B. Brown and colleagues, and began distributing private beta API access. GPT-3's 175 billion parameters made it substantially larger than any publicly described language model at the time, enabling strong few-shot performance across diverse language tasks.