Google Open-Sources GPipe Library for Faster Training of Large Deep-Learning Models
Google AI is open-sourcing GPipe, a TensorFlow library for accelerating the training of large deep-learning models. Deep-neural-networks (DNN) are the tool of choice for solving many AI tasks, such as natural-language processing and visual object detection. New methods for the latter are often benchmarked against winners of the ImageNet challenge. Each year’s winning entry has performed better than the last; however, there is a corresponding increase in model complexity. The… Read More »Google Open-Sources GPipe Library for Faster Training of Large Deep-Learning Models