Learning Robust Autonomous Navigation and Locomotion for Wheeled-legged Robots
HTML-код
- Опубликовано: 23 апр 2024
- In our new Science Robotics paper, we introduce an autonomous navigation system developed for our wheeled-legged quadrupeds, designed for fast and efficient navigation within large urban environments. Driven by neural network policies, our simple, unified control system enables smooth gait transitions, smart navigation planning, and highly responsive obstacle avoidance in populated urban environments.
With the Swiss-Mile prototype robot, we have conducted kilometer-scale missions for months and proved the feasibility of our system for real-world applications.
Project website: junja94.github.io/learning_ro...
Paper link: www.science.org/doi/10.1126/s... 
Наука
Wow! this version of robot dog is amazing!!
Thank you 🙏 there are many more videos of the robot. Even standing on two legs 🤘
Amazing work guys. Been following your progress for a long time. My favorite robot dog of all!
Awesome! Thank you!
Good job! When it's in all wheel mode, maybe you can use some mechanical locks to fix the joints to save more electricity for the acutator on these joints. Keep only the necessary ones unlocked for steering left/right
The ones moving the legs up/down act as a kind of suspension from what I can see. Locking those would only be possible on mostly flat terrain
Good idea 👍
@@lolzdatguy4987 A lock pin with a piece of rubber, crusing on "mostly flat“ terrain :P
or just turn these axis into an end stop so motor power of these actuators can be turned off. A position with the main body close to the ground to also reduce aerodynamic drag
I'd love to see this in a fight to the death with boston dynamics SPOT.
We have arrived at the template for autonomous public carts. Finally something that works
Haha finally :)
Speed, climbing and jumping !!! That's amazing !
Thank you 🙏
This would be a really good replacement for the current food delivery robots, which are far too slow to outrun people with malicious intent!
Easily the most advanced robotic dog platform!
🤘🤘🤘🤘
This is brilliant. I absolutely love the combination of wheeled and legged locomotion, and the way they interact and complement each other, not just switch. Can't wait to see these things learn and become more agile and graceful.
The wheels even help when going up the stairs :)
@@leggedrobotics Exactly. If you guys keep at it, the thing will be hopping and leaping around like a mind-blowing wheeled gazelle. 😊
Congratulation 🎉 to the team who designed this revolutionary concept of locomotion.
It was "The Wheelers" in the movie Return to Oz (1985) with Fairuza Balk. They are awesome characters, and this needs to be dressed in that costume.
INCREDIBLE DESIGN
Glad you like it!
This is a game changer in autonomous navigation. Kudos to the team who made this possible.
Thank you 🙏
Good job guys!
Thank you
Oh shit! It's like a robotic Wheeler from Return to Oz.
Exactly! My childhood nightmare is now real 😂
The wheelers are coming 🚴
I love the idea. Pure leg-walking is so inefficient
Agreed 👍
If this is real (ie, not CGI) then it's very impressive. What troubles me is that robot voice. It lends a synthetic air to the entire video.
It’s real :)
Man, that looked like one badass transformer...🔥🔥🔥
🔥 🔥 🔥
This is such a joy to look at
🥰
very cool work excited to see how anymal has progressed over the years and for what comes next
We will try to keep up the pace!
I've always said that the robot that we will ultimately use for general purpose won't look like a human and have normal fingers and legs. If you gonna build something to physically assist us why start with a human frame with its known limitations. These guys have it right. Take the best parts of as many species and vehicles as possible.
That’s correct! Do not copy nature if we have different tools to build machines.
Impressive policies! Amazing that the policies learned in simulation transfers to the real word
We know how to transfer it :)
@@leggedrobotics Cool I'll check the paper!
Great job. The combination of modes is amazing!
Glad you think so!
incredible, this needs further funding, improvement and to be sent to Mars
Our spinoff Swiss-Mike is taking care of that 🤘
if such a robot is much more economical than a robot on legs, then your idea will definitely win in the future!
Fingers crossed 🤞
Cool, make one with handle bars and a seat please
Good idea. The next gen motor bikes 🚴
SURE GrandMuters diving Robots lolz
BETTER MAKE it pull a Fairytale carriage
This would be great for a handicapped person to gain more mobility.
Looks like something you’d see in the “Tales from the Loop” books
this is the ultimate solution for robot legs. felixable like human leg, faster than human leg
I like the slogan at the end
Smart! Can’t believe this isn’t more common
We are the first mover!
Don't worry, robot world domination is coming to us soon enough!
ETH is top!
This is getting better and better.
💪
Wow. Fantastic
Thank you 🙏
This looks like a winning design.
Thanks 🙏
우와 충격적인 관절과 대응 타이어에 변화에 대한 허용범위와 대응 그리고 타이어는 바로 정교함에 여유를 주는 요소이고 관절대응은 정말 인간을 넘어서는 순발력이네요 연구진들 대단합니다.
Thank you 🙏
Autobots.... Roll out!!!!
Autobots are becoming real 🤩
“Wake up babe, new Robotic System Labs: Legged Robotics at ETH Zürich video”
Wake up babe.... someone posted wakeup babe meme again...
That’s right!
I'd love to know how you picked a scalable framework. Looks great.
I would envision in future where people will ride on this thing like a horse or bike, VERY COOL!!!
Yesss! That’s what I’m sayin
I'm just in love with this thing, i don't get why everyone makes robots with normal feet when you can have this and waste less energy and be faster, especially if you can switch configuration. Are feet just more stable at this stage of learning?.
People like to copy nature
very smartly done !
Thanks 🙏
Quite a phenomenon in the last few years.
Thank you 🙏
Lol, Wizard of OZ! That robot is really strange and cool. You can see it processing walk or rollkneecaps.
It also needs kneepads. It was bumping its poor knees.
Looks a little clumsy, but with more time machine learning, I bet it will be awesome!
It already has knee pads :)
Incredible design! Color me inspired
Thank you! Cheers!
This idea is impressive. I wonder how much this can extend the battery life compared to full walking mode.
By a factor of 2 and more that’s 3 times the distance.
Next-Level
Thank you 🙏
The future has already begun
Finally
Anymal is such a great platform.
If I were an engineer I'd definitely use wheels, but I'd make them be able to either lock to become just the end of the leg, or pivot out of the way. Relying on just the motor to lock the wheel gives the robot a less stable footing in some situations. Be groovy to teach the robot how to move with its wheel when that's the most efficient, but use feet when the wheels are an impediment. Like the Tachikoma on Ghost in the Shell. (The smart spider tanks. I imagine all the developers on this project are into science fiction).
You can always become an engineer :)
Lassie is onto it.
What does this mean?
woo! this is great.
💪
love it keep the good work going❤
We will 🤘
They need to be strong enough to arm them with Panzerfaust and Tank Killer Rifles, first strike and fixed defensive positions are perfect for these killer robots
We do not add weapons on our robot!
this is absolutely impressive
Thank you 🙏
The iterations are visibly distant from one another in thresholds and competence. And it's still accelerating.
Exponential growth!
This is excellent work! Have you published your source code and trained models?
No, sorry
It reminds me of the wheelers from the movie return to OZ
It’s a great movie 🎥
True yes
Amazing ❤
Thanks 😄
YAP ! Wheels/legs combination is the best for robot moving, if I make robot it will do the same.
Exactly 👍
Amazing! Now bombs are 10x faster in 10 km of autonomus range! ❤
That’s bad 🙅♂️
What is the runtime for this robot before needing to be recharged? I could see something like this doing security for a compound, or, search and rescue etc, but only if it had several hours of charge
Our startup Swiss-Mile is commercializing the robot for security. Their new robot can run for 5h.
can you train it to skate along like an inline skater? I could see it hitting narrow gaps just balancing on one side and tucking in the the other wheel set
We did that already. Check out our other videos
I have seen the future of food delivery here, well done 👏 would love to work for you guys 😍
Thanks!!
The competition of robots.
Let’s make them a reality ❤️
'Return to Oz' nightmares
They are coming back 🤯
Does it give a precise control over the distance it moves?
Yes
This is the way
"Best of both worlds"
Good video!
Thank you
I spotted Sarah Connor in the background in the distance.....👀
Haha so you must be German to know Sarah Connor
why not make the robot able to lock the wheels when going up stairs or such?
Because the wheels even help when going up the stairs. The robot merely rolls over the edge of the step.
It will be cool when it's real. Notice the blurred image around the robot. Seems very CGI
Haha no CGI
Why is there a unitree B1 or B2 clip at the very end?
The company Swiss-Mile started to commercialize an adapted version of unitree.
They stepped progress into hyper drive mode. 😂
What does this mean?
Wow! AKIRA 炭団 has been realized
Finally!!
A variant of this could be to have a homolid robot ride an e-bike (or e-trike or e-unicycle or e scooter) and then dismount when and push the e-bike et al when needed then remount the bike and ride on.
This then would extend this controller to humanoid robots where the wheels are not part of the bot but are separate. This allows legacy products that are already optimized to be efficient and already exist to serve the wheeled function and the two, the bot and the bike act as one just as the wheeled robot dog but with even more versatility.
But the control is much the same the only addition being the AI to mount and dismount the e-bike and to be able to push it when walking. But even that is a plus in that it would be easir for the bot to maintain balance when walking when pushing a bike in that would give it more stability and make it less likely to fall.
Thus imagaine a humaoid robot riding say a cargo e-bike and doing last mile deliveries where it rides along the street just as any cyclist would then gets off at its destination and leaves it package and then remount its cargo e-bike and moves to the next delivery. This is something a robot dog (even on wheels) would not be able to do.
Cool future
хочу себе такой, с местом для пассажира, с джойстиком (или еще каким устройством для управления, конечно чип в мозгу был бы прекрасен)
We will work on it.
So how much is it? You can also put a saddle on it
Yes 🙌
I wonder how this would function with mechanim wheels on it aswell
So, Metalhead is gonna have wheels in this timeline of Black Mirror? yay
This will become the good version of metalhead :)
You should make it so that the wheels can change from wheels to stilts or something so it can more efficiently go up stairs or hills
Ps. If accomplished then in theory the robot could be able to walk 😅
Actually by using the wheels the robot can roll up the stairs and be more efficient depending on the kind of stairs.
@leggedrobotics I mean I'm not saying it can't but I noticed it skirted a little going up those stairs, so idk maybe more grip but I still think the ability to go from wheels to walkers wouldn't be a bad idea especially if you want the robot to be more versatile, NOT hating LOVE THE BOT just saying thanks for responding 👍
Great progress on the robot. But why the AI voice? :(
Good question
Aren't you guys using the Nvidia Omniverse for simulation?
This work uses the one that was developed in-house.
Здравствуйте, Подскажите, пожалуйста, А могли бы установить кресло для инвалидов на этого робота? Интересно посмотреть, какой вездеход ступенькоход получится для инвалидов - колясочников.
We will try our best to achieve that 🤞
Just skip the wheel motors and have it rollerblade around!
The first robot we designed 7 years ago had rollerblades. There is a video of it on our channel.
Probably a naive question, but why don't we use both legs and wheels together? wherever legs are better then wheels can be folded up likewise legs.
It is using both even when going up the stairs.
2:13 Terminator detected
The dog or the robot? 🤔
@@leggedrobotics 🤖
❤❤❤
❤️❤️❤️
Agora testa numa favela aqui no RJ
Next challenge!
What’s the battery life like?
It depends on the mission. Roughly around 2 hrs for the missions in the video
@@leggedrobotics not bad.
Nature is precius
Agreed 👍
Id like to see one that skates on ice.
Good idea!
지상 드론 같은 느낌이다.
True
I enjoyed the robot, but was thrown off by the ai narrator. Its okay to use an ai narrator, but use a better one. And please dont have him read the titles in your script.
Thanks for the feedback. Next time, we will use a real voice
@@leggedroboticsThank you!
That. Look 5
@@leggedrobotics As a professional voiceover artist for the last 10 years who's been seeing less and less work due to AI, thank you
I offer my voice free of charge🤙
Fuchikoma predecessor
👍
Exactly
this is just irl Puppytruck by Sean Dick
Haha
every day you know new artificial form of life automatized
What a time to be alive!
That thing is nothing but another moving target...
*THE WOODS AIN'T SAFE!*
😂
Please Have one pull Fairytale Carriage
We will!
какой ёмкости аккумулятор, какой расход энергии ?
Check out Swiss-Mile the startup. They have now 5h. :)
scale that up for my iron horse.
Why?
Hello how make dansing
Next time :)
i guess usage of motorised wheels is a failure
instead of using rotating ankle/wrist that will allow to induce rollerskate moves and many others climbing abilitys
We started with rollerskates and the performance of motors in the wheels allows for higher performance.
@@leggedrobotics i meant the rollerskate move need a diferent ankle motor for pushing like a oar
obivously the spped is limited
ohh noo ooohhh nooooo Return to Oz becomes reality!!!
Yes 🤩
i need a car like this plz 😨😨
How much are you willing to pay? 🤔
@@leggedrobotics
lets make a deal? i brought up the idea to turn this epicness into a car and then you will make history. Youre company will be remembered for the first to make the legged robot car. Therefore i think i deserve at least one of the first you sell?✔✔
Early tachikoma.
It’s just the beginning