Google is developing next-generation multitasking AI

Google is developing next-generation multitasking AI

Today’s AI models can for the most part be trained to do just one task.

When retraining a neural network, it will most likely “forget” all previously acquired knowledge.

Google is developing a “next-generation AI architecture” that should be much more versatile. Last Thursday, Jeff Dean, senior vice president of Google Research, blogged about Pathways, an AI project aimed at making it easier to develop neural networks that can learn thousands, possibly millions, of tasks.

At the same time, the knowledge gained in learning how to perform one task will be generalized to help in solving subsequent tasks. A typical neural network today can process text, audio, or video, but not all three types of data. The Pathways project envisions the creation of neural networks that can combine different types of information to make more accurate decisions. “The result is a model that is prone to deeper inference, less prone to error and bias,” Dean wrote.

In addition to the already mentioned advantages, the new architecture will also be faster and much more energy-efficient, since it will only activate those parts of the neural network that are absolutely necessary for the given task. Dean said applying a similar “sparse activation” technology to Switch Transformation’s natural language processing model and another AI model, called GShard, reduced their energy consumption by a factor of ten. Google’s replacement of multiple AI models with a single multipurpose neutron network will provide important business benefits.

One of the outcomes of the Pathways project could be the improvement of Waymo’s autonomous driving system by increasing the efficiency of information processing. In the public cloud, providing customers with more versatile neural networks could help Google make its AI-driven services more competitive. In addition, Pathways will enable the company to improve the services it provides to consumers, in particular Google Search.

“Pathways will allow a single AI system to summarize thousands or millions of tasks, understand different types of data, and do it with amazing efficiency,” said Dean. It is such a system that can lead us from the stone age of artificial intelligence, “the era of single-purpose models that simply recognize patterns”, to a model in which “general-purpose smart systems will provide a deeper understanding of our world and can adapt to new needs.”

If you like the material, tell your friends about it. Thank you!

Related Posts

Oppo Watch 3 – all details revealed

The Oppo company will soon present its new smartwatch, the Oppo Watch 3. The model should receive an LTPO display with LTPO technology, which makes it possible…

What new products will Samsung show on August 10

A live broadcast of the event, where the audience will witness a number of new Samsung gadgets and products, will take place on August 10. What the…

LG Ultra Tab officially presented

The LG company officially presented the new LG Ultra Tab tablet on the South Korean market. The model received the Android 12 operating system, a 10.35-inch IPS…

Samsung Galaxy A23 5G officially presented

Samsung officially presented the new Galaxy A23 5G smartphone. The model received support for operation in fifth-generation networks. The smartphone is available in configurations with 4 GB,…

Nothing will release two models of wireless headphones

Recently, the business debuted the Nothing Ear headphones (1), but now it was revealed that there would be two other kinds of wireless devices. This is according…

The cheapest Redmi smartphone with 5G gets MIUI 13

Redmi Note 9T was the first smartphone of the Xiaomi sub-brand for the international market, supporting 5G networks. It was one of the cheapest options with such…

Leave a Reply

Your email address will not be published.