Scroll Top

Google built a four legged robot that then taught itself to walk


If we have to teach robots how to do everything the rate innovation in the field is going to be lethargic, but if robots can teach themselves it’ll dramatically accelerate their rate of development.


Interested in the Exponential Future? Connect, download a free E-Book, watch a keynote, or browse my blog.

There’s now a robot with the walking capabilities of Bambi, which is more impressive than it sounds especially when you realise that this robot, like only a few before it who now sort recycling, and drive race cars, has learned it’s new skill not by being programmed as is normally the case with robots, but has learned how to walk using intuition alone.

Researchers at Google, the Georgia Institute of Technology, and UC Berkeley, who published a paper this week, all worked together to create a robot that used nothing more than AI to teach itself how to walk, and they nicknamed the little four legged robot “Rainbow Dash.”


See also
Mine hunting drones can now detect mines from the air


The new type of robot uses a kind of AI called deep reinforcement learning that combines aspects from two different kinds of AI – deep learning and reinforcement learning. With reinforcement learning, an algorithm learns how to perform a task through trial-and-error, where it receives rewards and punishments depending on how close to achieving its task it gets, and deep learning allows systems to process and evaluate raw input data from their environments.


See Rainbow Dash in action

Normally tests of reinforcement learning algorithms are performed within simulated computer environments so this latest step into the real world is a big one, literally and figuratively. Researcher Jie Tan, who is also head of locomotion at Google, said the research took about a year to complete.

“We are interested in helping robots navigate in diverse and complex real world environments and it’s difficult to manually engineer a robotic locomotion controller that can handle the complexity of the real world. Meanwhile human learning is automatic, requires little prior knowledge, and can scale up with the amount of experience collected, so we believe that for these legged robots to operate in the real world the ability for them to learn by themselves is crucial,” he said.


See also
The world's most advanced humanoid robot takes parkour in its stride


The researchers started Rainbow Dash out on a flat surface, where it figured out how to walk within 1.5 hours. Next they tested it out on some slightly more challenging surfaces — a squishy memory-foam mattress and a doormat with lots of crevices. The robot took 5.5 hours to figure out walking backwards and forwards on the mattress, while the doormat only took 4.5 hours.

Rainbow Dash was not entirely bereft of human supervision though, since researchers still had to intervene when the robot accidentally left the space it was meant to learning in, and when it fell over — although they were able to tweak its algorithm to stop it wandering out of the space. But looking to the future Tan sees legged robots as being increasingly useful.


See also
The toughest known structure ever has been discovered by a robot lab


“Legged robots will have great mobility. They will be able to walk in all the places that humans can go, as well as environments that humans cannot,” he said. “Now is still the early days of research. Next, we plan to test our learning system on a wide range of robots and in a more diverse set of environments,” he added.

Related Posts

Leave a comment


Awesome! You're now subscribed.

Pin It on Pinterest

Share This