Google is using GeminiAI to make its robots smarter and better, here’s how

Google is empowering the robots to be more flexible and adaptable by remembering and understanding their environment, thanks to Gemini 1.5 Pro model

Google's Gemini AI is Making Robots Smarter | Inc.com

According to the research paper, Google Gemini 1.5 Pro is using an extended context window. This allows the AI model to process a lot more information than earlier. What it also does is that it empowers the robots to be more flexible and adaptable by remembering and understanding their environment.

Google’s DeepMind robotics team has published a new research paper detailing how it is changing robot navigation using Gemini 1.5 Pro — one of its more advanced AI model.

How Google is making robots smarter

The whole process begins with researching filming video tours of offices, homes, or other surroundings. The robot — powered by Gemini 1.5 Pro — then watches the videos to learn the layout, where things are kept and get a better idea of the area.

The robots are then given commands and use their memory from the video to navigate better.

Gemini AI can make robots smarter,' says Google - Technology News | The Financial Express

The DeepMind team tested these Gemini-powered robots in a vast 9,000-square-foot area. Almost 50 different instructions were follow accurately 90 per cent of the time by the robots.

However, there seems to be a lot of room for improvement, as per the researchers. At the moment, even with Gemini 1.5 Pro, the robots take 10 to 30 seconds to process each instruction, which is rather slow for real-world use.

Google said that it evaluated the method in a office and home-like environment and achieved 86 per cent and 90 per cent success rate, which was 26 per cent and 60 per cent higher than baseline method than earlier models. For instance, if you ask the root “where did I leave my phone charger”, then the robot leads you to a power outlet it remembers from the video.

Also, the testing so far has been done in controlled environments. So, robots aren’t really going to take over your home or office at the moment but Google is working to make them navigate the surroundings smartly and surroundings smartly