Google Brain
Google's deep learning research team, founded 2011. Produced influential work in large-scale neural networks and natural language processing before merging with DeepMind in 2023.
3 milestones
Andrew M. Dai and Quoc V. Le Introduced Semi-Supervised Sequence Learning
In November 2015, Andrew M. Dai and Quoc V. Le at Google Brain published 'Semi-Supervised Sequence Learning', showing that pre-training recurrent neural networks with unsupervised objectives, language modelling or sequence autoencoding, before supervised fine-tuning improved text classification accuracy and training stability, anticipating the pre-train-then-fine-tune paradigm later adopted widely in NLP.
Google Brain Unsupervised Neural Network Learns to Detect Cats from YouTube Frames
In June 2012, Quoc V. Le and colleagues at Google Brain published research showing that a 1,000-machine, 16,000-core neural network trained without labels on 10 million YouTube thumbnail images spontaneously developed a neuron selectively responsive to human and cat faces, demonstrating large-scale unsupervised feature learning from unlabelled video data.
Google Brain Founded by Andrew Ng and Jeff Dean
In 2011, Andrew Ng and Jeff Dean co-founded Google Brain, an internal research group at Google dedicated to large-scale deep learning. The project demonstrated that deep neural networks trained on substantial compute could learn useful representations without labelled data, reshaping how the industry approached machine learning research.