Nvidia
US semiconductor company whose GPUs became the dominant hardware platform for training deep learning models.
2 milestones
Microsoft Research released Turing Natural Language Generation (T-NLG), a 17-billion-parameter language model
In February 2020, Microsoft Research announced Turing Natural Language Generation (T-NLG), a 17-billion-parameter autoregressive language model trained using the Megatron-LM framework. At the time of release it was the largest publicly disclosed language model and achieved state-of-the-art results on question-answering and summarisation benchmarks.
NVIDIA GeForce 256: Introduction of the Graphics Processing Unit (GPU)
In 1999, NVIDIA released the GeForce 256, which the company marketed as the first graphics processing unit (GPU), a single-chip processor capable of performing transform, lighting, clipping, and rendering operations that had previously required the host CPU, enabling sustained high-throughput parallel computation.