Google Brain

Google Brain From Wikipedia, the free encyclopedia Jump to navigationJump to search This article contains content that is written like an advertisement. Please help improve it by removing promotional content and inappropriate external links, and by adding encyclopedic content written from a neutral point of view. (February 2019) (Learn how and when to remove this template message) Google Brain Commercial? Yes Type of project Artificial intelligence and machine learning Location Mountain View, California Website ai.google/brain-team/ Google Brain is a deep learning artificial intelligence research team at Google. Formed in the early 2010s, Google Brain combines open-ended machine learning research with information systems and large-scale computing resources.[1][2][3] Contents 1 History 2 Projects 2.1 Artificial-intelligence-devised encryption system 2.2 Image enhancement 2.3 Google Translate 2.4 Robotics 3 In Google products 4 Team and location 5 Reception 6 See also 7 References History The so-called "Google Brain" project began in 2011 as a part-time research collaboration between Google Fellow Jeff Dean, Google Researcher Greg Corrado, and Stanford University professor Andrew Ng.[4][5][6] Ng had been interested in using deep learning techniques to crack the problem of artificial intelligence since 2006, and in 2011 began collaborating with Dean and Corrado to build a large-scale deep learning software system, DistBelief,[7] on top of Google's cloud computing infrastructure. Google Brain started as a Google X project and became so successful that it was graduated back to Google: Astro Teller has said that Google Brain paid for the entire cost of Google X.[8] In June 2012, the New York Times reported that a cluster of 16,000 computers dedicated to mimicking some aspects of human brain activity had successfully trained itself to recognize a cat based on 10 million digital images taken from YouTube videos.[6] The story was also covered by National Public Radio[9] and SmartPlanet.[10] In March 2013, Google hired Geoffrey Hinton, a leading researcher in the deep learning field, and acquired the company DNNResearch Inc. headed by Hinton. Hinton said that he would be dividing his future time between his university research and his work at Google.[11] Projects Artificial-intelligence-devised encryption system In October 2016, the Google Brain ran an experiment concerning the encrypting of communications. In it, two sets of AI's devised their own cryptographic algorithms to protect their communications from another AI, which at the same time aimed at evolving its own system to crack the AI-generated encryption. The study proved to be successful, with the two initial AIs being able to learn and further develop their communications from scratch.[12] In this experiment, three AIs were created: Alice, Bob and Eve. The goal of the experiment was for Alice to send a message to Bob, which would decrypt it, while in the meantime Eve would try to intercept the message. In it, the AIs were not given specific instructions on how to encrypt their messages, they were solely given a loss function. The consequence was that during the experiment, if communications between Alice and Bob were not successful, with Bob misinterpreting Alice's message or Eve intercepting the communications, the following rounds would show an evolution in the cryptography so that Alice and Bob could communicate safely. Indeed, this study allowed for concluding that it is possible for AIs to devise their own encryption system without having any cryptographic algorithms prescribed beforehand, which would reveal a breakthrough for message encryption in the futurereveal a breakthrough for message encryption in the future[clarification needed].[13] Image enhancement In February 2017, Google Brain announced an image enhancement system using neural networks to fill in details in very low resolution pictures. The examples provided would transform pictures with an 8x8 resolution into 32x32 ones. The software utilizes two different neural networks to generate the images. The first, called a "conditioning network," maps the pixels of the low-resolution picture to a similar high-resolution one, lowering the resolution of the latter to 8×8 and trying to make a match. The second is a "prior network", which analyzes the pixelated image and tries to add details based on a large number of high resolution pictures. Then, upon upscaling of the original 8×8 picture, the system adds pixels based on its knowledge of what the picture should be. Lastly, the outputs from the two networks are combined to create the final image.[14] This represents a breakthrough in the enhancement of low resolution pictures. Despite the fact that the added details are not part of the real image, but only best guesses, the technology has shown impressive results when facing real-world testing. Upon being shown the enhanced picture and the real one, humans were fooled 10% of the time in case of celebrity faces, and 28% in case of bedroom pictures. This compares to previous disappointing results from normal bicubic scaling, which did not fool any human.[15][16][17] Google Translate The Google Brain project contributed to Google Translate. In September 2016, Google Neural Machine Translation (GNMT) was launched, an end-to-end learning framework, able to learn from a large number of examples. While its introduction has increased the quality of Google Translate's translations for the pilot languages, it was very difficult to create such improvements for all of its 103 languages. Addressing this problem, the Google Brain Team was able to develop a Multilingual GNMT system, which extended the previous one by enabling translations between multiple languages. Furthermore, it allows for Zero-Shot Translations, which are translations between two languages that the system has never explicitly seen before.[18] Google announced that Google Translate can now also translate without transcribing, using neural networks. This means that it is possible to translate speech in one language directly into text in another language, without first transcribing it to text. According to the Researchers at Google Brain, this intermediate step can be avoided using neural networks. In order for the system to learn this, they exposed it to many hours of Spanish audio together with the corresponding English text. The different layers of neural networks, replicating the human brain, were able to link the corresponding parts and subsequently manipulate the audio waveform until it was transformed to English text.[19] Robotics Different from the traditional robotics, robotics researched by the Google Brain Team could automatically learn to acquire new skills by machine learning. In 2016, the Google Brain Team collaborated with researchers at Google X to demonstrate how robots could use their experiences to teach themselves more efficiently. Robots made about 800,000 grasping attempts during research.[20] Later in 2017, the team explored three approaches for learning new skills: through reinforcement learning, through their own interaction with objects, and through human demonstration.[20] To build on the goal of the Google Brain Team, they would continue making robots that are able to learn new tasks through learning and practice, as well as deal with compound tasks. In Google products The project's technology is currently used in the Android Operating System's speech recognition system,[21] photo search for Google+[22] and video recommendations in YouTube.[23] Team and location Google Brain was initially established by Google Fellow Jeff Dean and visiting Stanford professor Andrew Ng.[5] In 2014, the team included Jeff Dean, Quoc Le, Ilya Sutskever, Alex Krizhevsky, Samy Bengio and Vincent Vanhoucke. In 2017, team members include Anelia Angelova, Samy Bengio, Greg Corrado, George Dahl, Michael Isard, Anjuli Kannan, Hugo Larochelle, Chris Olah, Vincent Vanhoucke, Vijay Vasudevan and Fernanda Viegas.[24] Chris Lattner, who created Apple's new programming language Swift and then ran Tesla's autonomy team for six months joined Google Brain's team in August 2017.[25] Google Brain is based in Mountain View, California and has satellite groups in Accra, Amsterdam, Beijing, Berlin, Cambridge (Massachusetts), London, Montreal, New York City, Paris, Pittsburgh, Princeton, San Francisco, Tokyo, Toronto, and Zurich.[26] Reception Google Brain has received coverage in Wired Magazine,[27][28][29] the New York Times,[29] Technology Review,[30][31] National Public Radio,[9] and Big Think.[32] See also Artificial intelligence Glossary of artificial intelligence Quantum Artificial Intelligence Lab – run by Google in collaboration with NASA and Universities Space Research Association Noogenesis TensorFlow References "Brain Team mission – Google AI". Google AI. Archived from the original on 2018-06-20. Retrieved 2018-06-19. Machine Learning Algorithms and Techniques Research at Google. Retrieved May 18, 2017 "Research at Google". research.google.com. Retrieved 2018-02-16. "Google's Large Scale Deep Neural Networks Project". Retrieved 25 October 2015. Jeff Dean and Andrew Ng (26 June 2012). "Using large-scale brain simulations for machine learning and A.I." Official Google Blog. Retrieved 26 January 2015. Markoff, John (June 25, 2012). "How Many Computers to Identify a Cat? 16,000". The New York Times. New York Times. Retrieved February 11, 2014. Jeffrey Dean; et al. (December 2012). "Large Scale Distributed Deep Networks" (PDF). Retrieved 25 October 2015. Conor Dougherty (16 February 2015). "Astro Teller, Google's 'Captain of Moonshots,' on Making Profits at Google X". Retrieved 25 October 2015. "A Massive Google Network Learns To Identify — Cats". National Public Radio. June 26, 2012. Retrieved February 11, 2014. Shin, Laura (June 26, 2012). "Google brain simulator teaches itself to recognize cats". SmartPlanet. Retrieved February 11, 2014. "U of T neural networks start-up acquired by Google" (Press release). Toronto, ON. 12 March 2013. Retrieved 13 March 2013. "Google AI invents its own cryptographic algorithm; no one knows how it works". arstechnica.co.uk. 2016-10-28. Retrieved 2017-05-15. Abadi, Martín; Andersen, David G. (2016). "Learning to Protect Communications with Adversarial Neural Cryptography". arXiv:1610.06918. Bibcode:2016arXiv161006918A. Dahl, Ryan; Norouzi, Mohammad; Shlens, Jonathon (2017). "Pixel Recursive Super Resolution". arXiv:1702.00783. Bibcode:2017arXiv170200783D. "Google Brain super-resolution image tech makes "zoom, enhance!" real". arstechnica.co.uk. 2017-02-07. Retrieved 2017-05-15. "Google just made 'zoom and enhance' a reality -- kinda". cnet.com. Retrieved 2017-05-15. "Google uses AI to sharpen low-res images". engadget.com. Retrieved 2017-05-15. Schuster, Mike; Johnson, Melvin; Thorat, Nikhil. "Zero-Shot Translation with Google's Multilingual Neural Machine Translation System". Google Research Blog. Retrieved 15 May 2017. Reynolds, Matt. "Google uses neural networks to translate without transcribing". New Scientist. Retrieved 15 May 2017. "The Google Brain team — Looking Back on 2016". Research Blog. Retrieved 2017-12-18. "Speech Recognition and Deep Learning". Google Research Blog. August 6, 2012. Retrieved February 11, 2014. "Improving Photo Search: A Step Across the Semantic Gap". Google Research Blog. June 12, 2013. "This Is Google's Plan to Save YouTube". Time. May 18, 2015. Google Brain team website. Accessed 13.05.2017. https://research.google.com/teams/brain/ Etherington, Darrell (Aug 14, 2017). "Swift creator Chris Lattner joins Google Brain after Tesla Autopilot stint". TechCrunch. Retrieved 11 October 2017. "Research at Google". research.google.com. Retrieved 2017-08-01. Levy, Steven (April 25, 2013). "How Ray Kurzweil Will Help Google Make the Ultimate AI Brain". Wired. Retrieved February 11, 2014. Wohlsen, Marcus (January 27, 2014). "Google's Grand Plan to Make Your Brain Irrelevant". Wired. Retrieved February 11, 2014. Hernandez, Daniela (May 7, 2013). "The Man Behind the Google Brain: Andrew Ng and the Quest for the New AI". Wired. Retrieved February 11, 2014. Hof, Robert (April 23, 2013). "Deep Learning: With massive amounts of computational power, machines can now recognize objects and translate speech in real time. Artificial intelligence is finally getting smart". Technology Review. Retrieved February 11, 2014. Regalado, Antonio (January 29, 2014). "Is Google Cornering the Market on Deep Learning? A cutting-edge corner of science is being wooed by Silicon Valley, to the dismay of some academics". Technology Review. Retrieved February 11, 2014. "Ray Kurzweil and the Brains Behind the Google Brain". Big Think. December 8, 2013. Retrieved February 11, 2014. vte Google Categories: Applied machine learningGoogle Navigation menu Not logged inTalkContributionsCreate accountLog inArticleTalkReadEditView historySearch Search Wikipedia Main page Contents Featured content Current events Random article Donate to Wikipedia Wikipedia store Interaction Help About Wikipedia Community portal Recent changes Contact page Tools What links here Related changes Upload file Special pages Permanent link Page information Wikidata item Cite this page Print/export Download as PDF Printable version Languages Deutsch Ελληνικά فارسی Français 한국어 Português Русский 中文 Edit links This page was last edited on 17 April 2020, at 13:58 (UTC). Text is available under the Creative Commons Attribution-ShareAlike License; additional terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy. Wikipedia® is a registered trademark of the Wikimedia Foundation, Inc., a non-profit organization. Privacy policyAbout WikipediaDisclaimersContact WikipediaDevelopersStatisticsCookie statementMobile viewWikimedia FoundationPowered by MediaWiki