Avatar Robot Boxing: High-Speed & Impact-Resilient Teleoperation in Action!
HTML-код
- Опубликовано: 11 окт 2024
- In this video, we showcase our humanoid robot, Nadia, being remotely controlled for boxing training using a simple VR motion capture setup. A remote user takes charge of Nadia's movements, demonstrating the power of our advanced teleoperation system. Watch as Nadia performs precise boxing moves, highlighting the potential for humanoid robots in dynamic, real-world tasks. Stay tuned to see how teleoperation is pushing the boundaries of robot control!
every day we're a step closer to Real Steel
Xbox 720 anyone?
i was about to comment this..
Yeah, that fighting robot movie was awesome !!!
We had robot combat league, but putting the robot controller shoulders on the pilot's head level makes for janky monotonous fights
Fr fr
Real steel bout to be real
the steel is becoming realer
Real Steel is about to become just Steel
The realest of steel
Bars
More like skynet
Arm tracking is nearly 1:1 but leg tracking has a very pronounced latency. This leads me to thinking the robot must be coded to prioritize balance. This is also noticeable when the robot is punching, as it seems to adjust its balance by moving its legs even if the pilot doesn't do so.
Very interesting.
Good observation
The arms are NOT 1:1. The hands are matching the relative position to the operator and the robot arms just trying to compensate.
You can see the arms do not hold the same position. In one frame, where you're talking about his leg movements, you can see the operators arm fully extended, while the robot only does a partial extension.
Makes sense, it can't move it's legs exactly like a human because it's center of mass is in a different place, so it needs to balance differently
@@PanoptesDreams That is because only his hands are being tracked. It would be neat if he used some method of whole body tracking like LIDAR.
Perhaps the distance between the leg captors and headset play in the latency. Putting a cable instead of bluetooth connection could help reduce the latency. Not entirely, but maybe 0.1 - 0.5 s
Cyberbullying bout to become an even bigger problem
I mean, what type of people are gonna have access to such tech except for rich people and the nerds who built it.
@@dinnerboons1504 REVENGE OF THE NERDS
Wyd when the kid you've been roasting online sends a fucking robot to your house to kick your ass
Give war a chance!!!
No Jetsons flying cars, but we've got Real Steel boxing robots. Priorities.
flying cars would be an absolute nightmare tbh
@@chocolate_maned_wolf I’ve never been quite sure what exactly people mean by ‘flying car’ that isn’t just covered by regular aircraft like helicopters or VTOLs.
I personally picture some kind of magical wingless, rotor-less vehicle which can hover and move like a helicopter but which is also somehow almost completely silent and won’t suck you into a jet intake if you stand too close;
This is very different from the image of ‘flying cars’ from things like old Popular Mechanics covers where ‘flying car’ seems like it can mean anything from a tiny one-man helicopter that can fit in a garage to what I would just classify as just a regular airplane with four wheels.
Considering how stupid people tend to be with regular cars all the time, and how crashing aircraft usually ends up with almost everyone on-board dying, I don't think flying cars should ever become a thing. Drunkards are already driving into houses as is, but imagine them flying into buildings.
😂
Bro people can barely handle driving in what is basically 2 dimensions, having flying cars and opening up that 3rd dimension would be a fucking nightmare
Couple years from now this can be a real sport where either the robots box by the trained data you gave them or humans teleoperate them so the humans don’t get hurt during the match 😂
robot sumo has been around for a decade. It's the only sport I watch.
Sounds like a boring bunch of bullshit. Simp.
Why not just box in vr then?
@@erikm9768 machines getting slammed and destroyed in the boxing ring has its own appeals
@@DeimosSaturnThose are small toys, it's very different.
I can see an entire industry popping up in the future of people controlling avatar robots like this for working dangerous jobs or even just using them to be able to work from home
We get one step closer to Mega Man X.
Already do in Japan, have for years
African kids still cheaper tho
You should look up the movie "Surrogates", same idea.
@@cobaltbuster4907i watched It, damm i want to be in that world
Finally gonna get that Atom Vs. Zeus rematch after 12 damn years
Was supposed to be based of apollo vs rocky so I'd say atom becomes champion and beats zeus, then atom gets challenged by a random guy with a big robot, then atom gets beaten then the rich family that made zeus offers to upgrades atom to "prime atom" (If you've played the game you'd know who prime atom is) then atom fights whoever the new champion is and retakes his crown.
It is only a matter of time until we can spar and fight against robots. What a time to be alive.
Simp.
Why would you do that. If it's calibrated wrong you'll die.
Legit how would you knock out a robot 💀
Hold on to your papers!
@@s2tb2007go for the battery pack
Real. Steel.
Looks like so much fun to tele-operate like that. The robot seems so balanced and responsive. Probably took some serious engineering and testing to reach this point. Congrats!
Real Steel was a badass film!
Man. Imagine this robot being made with the same technology as industrialised machines. The power on this would be frighteningly good. 💯
It's so cool that because the balance is different, the legs are being noticeably translated more independently from the rest of the body.
That all the doorman and security jobs going at the local pubs and nightclubs.
Definitely will want them extra water resistant 😅
Fuckin fnaf but the guard is an animatronic
@@starsilverinfinity The patrons do get a bit freaky on friday nights
cue directional input rap battle @@pixelmace1423
@@starsilverinfinitythey have to hide from Certain fnaf fans
The latency is impressive!
ARE YOU READY FOR REALL STEEELLL!! 🔥🔥
Amazing. I see a new foot design that is able to flex centrally. This would mean that when you throw a left hook and the torso twists, the back heel of the left foot would come off the ground a bit. Maybe that would eventually lend to a more human-like walking motion with heel strike and sort of ball of the foot action. Also, when hitting the speed bag, don’t lunge with your hand to hit the bag. You’ll see that on the video playback. It’s a timing drill where your hand moves in a smooth circular motion. I’m not in physics but the hand hits the bag at a certain force which sends the bag away and the returning bag “meets” the hand again rather than the hand extending to strike the bag. When the timing is correct you’ll be able to get the bag going much faster with minimal additional effort. To generate faster control hands make the circular motion elliptical. The faster the hand speed the more elongated the ellipse becomes. That’s how to control the combined timing and power. I believe that control motion would translate from human to robot and get the bag going faster. Again, absolutely spectacular work!
Fun fact the most dangerous part of this whole experiment was actually not using the wrist straps on the controllers
I can see this both used for entertainment, and also military use.
Soldier drones would be terrifying.
1:40 he's hitting the "robot stereo cameras", and not reacting, are they just for show? I'm thinking he has a different point of view
i was just looking online about VR remote controlled robots! This is so cool!
we could use these to clean up toxic zones, amazing work here
Imagine if you could rent this robot to do a walk in vr in the another side of the planet and buy things to send later to you, the future is closer
imagine these on the battlefield where soldiers are out of harms way but still funtions like they're there.
It wouldn't work, the most basic jamming by the enemy and your robot soldiers would go kaput like the B1s in The Phantom Menace.
To be even remotely useful in a combat scenario the robot would need quite a fair degree of autonomous capabilities, like most drones have (but more advanced because walking is a lot harder than flying).
Where this system of teleoperation with direct control over the robot could be really useful is in non-combat dangerous situations, natural disasters, fires, etc.
Maybe even bomb disposal but only where the radio spectrum is controlled and safe (or with cable control).
@@qdaniele97the drone operators in Ukraine would like a word with you 🤣
@@qdaniele97 this guy has no idea how drone warfare works lol.
@@qdaniele97I don’t think that’s how it works irl lol, it’s not like that.
@@ferret3046 @MrSoso1050 Ah yes... because there are lots of humanoid drones with AR-like control deployed in ukraine right now.
Most of the "drone" currently deployed in ukraine (or in most other war fronts) right now fall in three categories:
1) Radiocontrolled, semi-consumer grade, small, cheap multicopters with camera used (actually repurposed) for reconeissance. These aren't even really drones (depending on definition) because don't have any autonomous capabilities whatsoever, other than maybe assisted level-flight controls. You could already have bought a multicopter like that in 2010 in a RC-model shop with exact same functions but nobody would've calked it a "drone".
2) Semi-autonomous, relatively small multicopers or planes with some automated flight capabilities (following GPS waypoints and things like that) used for recon and/or kamikaze attacks (strapping some sort of bomb to it).
3) Real-deal large military UAVs, controlled by satellite-links from far away (far less subsceptible to jamming because of the highly directional radio-link), also capable of some autonomous flight (autopilot-like). Used for high altitude recoinessance and air-to-surface misdile strikes. These were used in ukraine but only to a limited extent because are expensive and relatively easy to shoot down by the endmy if it has mostly your same level of technology and equipment.
I don't know what other "drones" you think have been deployed to ukraine, or where ever else (or even think exist at all), but if they are much different thsn any of these then I'm sorry to say, you are the ones with no idea what you are talking about.
Just a quick one, you might want to design the feet in a way that allows the bot to balance and pivot on its toes. This will allow it to generate power in those punches as well as other footwork techniques.
This is a great application of humanoid robotics. Teleop always is!
Keep up great work folks very interesting indeed thanks for sharing 😎🤟
now this is some real steel
This hand of mine is burning RED!!!
0:22 The Police officer T Bagging the Rioter
I wonder if it's possible to make wearable exoskeleton with force-feedback so you could feel the force and movement limitations of the robot? it's kinda like sim-racing motion simulator for your body
Just like Striker Eureka.
@nathanpartridge3565 someone who actually knows pacific rim? Respect
I’m paralyzed. Can I get some help to stand and walk ?😅
Someone needs to build this man legs!
someone get this man some legs!
Gotta get that setup that Huey from MGSV has
Everyone’s talking about Real Steel, but I’m here thinking of VR games
A VR game that's actually Real Steel in augmented reality.
Can’t wait to play Rock ‘Em Sock ‘Em Robots with these!
Next step, make the robot 50X bigger so it can take on Godzilla.
Is the robot reacting in real time, or did the movements of the operator were done first, and then sent to the robot, and the videos were stitched together? If the camera was moving, and the operator and robot were obstructing each other at one point, it would be obvious, but with them standing on two seperate sides of the frame, and the static camera it would be easy to stitch two shots together.
Regardless, the speed at which the robot can move is pretty impresive!
Real time
You can literally seen them side by side
It's the latency
It has the potential to be a spectacular entertainment show.
oh look, the beginning of a new sport
wow this is great. you can tell the robot do balance calculation
I like the robot on the left, it's very impressive.
It's about time.
Can you make the robot record the moves, then when you ready, you push a button and then the robot begin to execute the moves? Might be the solution for a mech robot where the driver is affected if the robot gets a blow.
Ive had so many ideas about how this kind of technology could be implemented into a variety of situations that its not even funny. This could be the future of armed conflict, rescue operations, first responders, and so many others. The idea of Real Steel is understandable given the context of the demonstration, but the possibilities are so much larger than just robo-boxing.
Nice! Real Steel will be a nice sport for us to watch and bet! :D
Too much latency. But interesting nontheless.
Yeah, the latency is going to last for sure. Try to be more interesting nonetheless. Proofreading before posting is a great way to start!
I guess its a good thing nobody asked you! ☺️
Ah the inevitable let's point out differences between prototype and production as if they can't be optimised
It seems like the only problematic latency was in the legs/foot placement. The rest of the body is up in the air as they weren't showcasing how fast it could move. I wonder how it responds if the pilot threw their punches as fast as they could; more so for the speed bag test and if it would get caught and hit its' own arm.
I misread that for teleportation and got excited.
High speed is something else. But still amazing.
When people ask me what my favorite movie is, the only one I can every qualify to be set as a "favorite movie" would be real steel. I love starwars and the like but on its own real steel is special, and soon everyone will know why, clearly! 😊
im calling it. 100 years from now we will have walker mecha
even if this doesn't bring about a robot boxing sport it'd be pretty gnarly special effects for a movie
i can't wait to saw them send in Space !
And imagine controle it from earth or randome salettelite, by VirtualReality, we can walk anywhere they can land, asteroid, field of asteroide, land, technical operation, & more
This steel is getting real
Atom's grandpappy lookin' wild
Drone Police Officers (Code 8) then Drone Soldiers come to mind, then new Geneva Conventions - then Real Steel (2011)
Ahh, real steel. They tried to warn us but we never listened IM READY 😎
Fuck I’ve been dreaming of VR X robotics, I imagine these things being like four inches tall that’d be sick
Excellent news for search and rescue
Really real steel
They show a bot that is roughly the same size as the man but there's nothing stopping it from being designed scaled up or down.
It would be super interesting to see someone who moves fast do it!
Also, I wonder if the motors can handle any actual force, or is it still just about precision?
This has potential for a new sport! Boxing could become something like formula 1 competition! And it does not have to be boxing. It could be some agility competitions. But in order to make it fun I think the robots need to outdo humans in athleticism significantly. Maybe otherwise it might not be appealing to the public. But if this happens, there could be a lot of funds to finance robotics and evolve it.
For obvious reasons, the hands have low latency but this thing's legs shouldn't move as quickly as the operator's because it's center of gravity and balance is all different. If you try to mirror the leg motion with no recalculation, this thing will just topple. It looks like the legs are programmed to "plant your feet where the operator plants his feet, and act like an immobile platform from there"
Speed bag was hilarious
Robots will take over combat sports in the far future
Real Steel vibes 💪
In terms of the future of these, these seem like a great advancement for doing dangerous jobs remotely. The part that sucks is how easily society would agree to revert that progress if even just one wrong person were to get one and do something bad with it.
I guarantee you. If this company decided to make multiple of these robots and have a robot boxing tv series they would make so much money
Can’t wait for the atom vs zeus rematch
This is it!! We're actually in the black ops 2 timeline dear GOD
*_Real Steel_* here we go!
dystopian as heck
I’d pay a monthly fee just to be able to box people and be in competition
latency is about 1 frame in a 24fps video, or 41ms. That's literally unbelievable for hardware latency.
Atom! Finish it!
When do Real Steel championship begins?
Befor téléportation it's Téléoperation !
I can finally live out my dream of fighting a robot
So real steel is gonna be an actual sport in the future!
Does he go slow with punches on purpose for the robot to follow?
i misread the title and was like "they taught these mf robots how to box AND teleport?"
Живая сталь
It's time for steel to get real!
This needs to be its own weight class in the UFC.
How the hell you guys made the respons so fast?? How to control the inertia/momentum after every single punch thrown?? How heavy is that robot??
Siii, que lindo!!! 🎉🎉🎉
Espera cuando saquen a tu profesor de boxeo del juego y lo cambien por un émulo de hojalata.
FINALLY! I’ve waited my entire life for this to exist, THANK THE LORD, and people who created it.
ive been wondering why no one has made this technology, finally real steel irl
I can see how the leg systems and upper body are fighting for motion control whenever it is walking/adjusting stance. Does having a large variance in the gyro moment / center of mass change from the arms make the walking algorithm fail?
Bro, is Atom from Real Steel
REAL STEEL!!!
You know, you didn’t have to add the legs. Just have him hang from the ceiling while throwing punches. The piñata that fights back.
It could be a great replacement for humans in wars. No more sacrifice
My dyslexia went teleportation instead of teleoperation, I was like "Wait what? This robot went to Yadrat and learned teleportation?".
No we can do Muhammad Ali vs Mike Tyson with Robots.
Wow, I can’t believe they made the robot out of Real Steel and not some other metal
It’s crazy how that’s actually less impressive than having it walk upright like a person 🤯
Time to edit this with Real Steel trailer music
Added the sfx sounds to the Rise of the Robots.
This is terrifying
Pathfinder is real! :)
REAL STEEL HELL YEAHH!! ATOM! ATOM! ATOM!