When AI was in its infancy in the 1960s, the dominant paradigm involved using symbolic, hand-coded representations of knowledge that could be processed by a computer using rules of inference. The biologically inspired alternative to symbolic AI was artificial neural networks that learned to use the activity patterns of large sets of neurons as distributed representations of data. The neural network paradigm was largely unsuccessful until 1986 when Dr. Hinton and his collaborators introduced the backpropagation algorithm and demonstrated that neural networks could learn distributed representations of concepts from symbolic data. Currently, this technology is the standard method for learning neural networks, with the number of references in academic papers to date exceeding 60,000. However, the practical applications were limited because the datasets were too small and computers were too slow. Interest then faded in artificial neural networks and they experienced a 'winter' in the 1990s.

Amid the fluctuations in popular interest, Dr. Hinton continued to pursue research on neural networks with great diligence. In 1993, he introduced variational inference (a form of approximate Bayesian inference), for neural networks. In 2002, he introduced a fast learning algorithm for restricted Boltzmann machines (RBM) that allowed them to learn a single layer of distributed representation without requiring any labeled data. These methods allowed deep learning to work better and they led to the current deep learning revolution. In 2009, Dr. Hinton and two of his students used multilayer neural nets to make a major breakthrough in speech recognition that led directly to greatly improved speech recognition. In 2012, Dr. Hinton and two more students revolutionized computer vision by showing that deep learning worked far better than the existing state-of-the-art for recognizing objects in images.

To achieve their dramatic results, Dr. Hinton also invented a widely used new method called 'dropout' which reduces overfitting in neural networks by preventing complex co-adaptations of feature detectors. He also invented 't-SNE' for visualizing high-dimensional data in a two-dimensional map. Of the countless AI-based technological services across the world, it is no exaggeration to say that few would have been possible without the results Dr. Hinton created.

AI has become widely used in various situations in our everyday lives, including image recognition by computers, audio responses by smart phones, experiments in self-driving vehicles and automated diagnosis of medical images. Since its birth 70 years ago, AI technology has finally gained a status that enables it to make major contributions to humankind. The achievements of Dr. Hinton make AI the means for creating a new society, and AI is expected to play an important role not only in creating safety and security in society, represented by the development of advanced transit systems, but also in resolving many global issues in the fields of energy and climate change that humankind must address. For these reasons, the Prize will be awarded to Dr. Geoffrey Hinton for his outstanding achievements.

Attachments

  • Original document
  • Permalink

Disclaimer

Honda Motor Co. Ltd. published this content on 20 September 2019 and is solely responsible for the information contained therein. Distributed by Public, unedited and unaltered, on 20 September 2019 02:41:04 UTC