Thank you to everyone for watching and taking the time to leave such kind words about the project! I'll have some more information on the channel very soon!
To add vehical information you could possibly send the images to a database of cars and have it figure out what kind of car it is, it would be cool to have a version of ChatGPT and figure out a way to interact with the helmet controls in place of Jarvis, but great job thats looks so freaking cool
Could you possibly put a small camera in the helmet to provide retina tracking so as to sync it up to the object detection? This should be an easy mod for you and it would add stability to the system in large open areas. Great video btw!!
It’d take too much memory to build a database of any possible object that object detection could lock on to. Maybe instead could pair it up to google images and maybe a simple AI like alexa to display relevant info
Yeah you could also lower the opacity and size of the UI elements and maybe lower the resolution of them then blur it so you don’t notice, so that you can see more, but when you look at one it will get bigger and come to full opacity. As another comment said you could use an AI such as GPT-3 and display relevant info of an object using Google. You could also add interactivity to the UI e.g have it so you can look at something and blink twice to select it. This could also allow you to easily toggle object detection on and off when you do/don’t need it which could help with performance. Another thing that could help with performance is using foveated rendering to lower the quality of the screen if it is in your peripheral vision, where it is already blurry to you.
You do realize that you basically just made your own VR headset, right? Very awesome stuff. I had brain-built something like this, but wasn't able to put the time, money, or skill into it. You did a WAY better job than I could have, and not only am I impressed, but hugely thankful that you took this to stratospheric levels. I can't compliment you enough!
Once in a while, youtube recommendations actually produce some gold. This is one of those times. Excellent build and I look forward to see further advancements and features to be incorporated into the design!
This is great! I always felt like the Iron Man suit (at least early versions) did eye tracking to see where Tony was looking. If you could get that implemented then you could be more specific over object detection and potentially use it as a control interface. In fact, a button in the suit glove and eye tracking should be plenty to control it without having to hold that keypad up to your face.
I would imagine you also want your “Jeeves” to provide you with queues on what you’re not currently looking at. That’s more proactive than reactive. IMO, getting stable and reliable output from the object detector is more important. Just my cents (by the way, what happened to the cents symbol on my phone keyboard).
Kris, I saw the time on this - over 30 minutes - at the end, I could not believe how fast it went, you did a fantastic job designing , building, programming and testing. This is a project you are justifiably proud of and will be fun to follow as it continues to develop
The fact that you could fit all that inside the helmet is just crazy! That's so tight! And you even manage to not make the eye looks weird! This is next level
Thank you! It seems everyone has different opinions about the eyes. For some people they stand out and for others they don't. I think it matter a lot how close you are.
@@kerseyfabs As someone who's in the process of converting a premade display prop Halo Spartan helmet into essentially this, fitting it all in has been hours and hours of dremelling and 3D printing adapter mounts/plates for everything. Definitely gonna take some notes from your work and see if i can revisit my internal layout !
Chris you should be so proud of your accomplishments! Thank you for sharing your experience and proving this is possible. I'm so inspired to do this with my builds now!
Great job! For the lag :You can split the video with hardware right at the camera's output. From the split section you connect your video directly to the output mixer as background( hardware again). From the second split section you feed into your computer and retrieve only the interface. Project the interface on top by connecting to the output mixer. This will give you a live feed without lag. The only lag that can possibly exist, will be at the interface.
the fact that more people trying to approach utilitarian perspective where it "actually" works. and not just gimmick is what's going to advance human technology to next level. Keep up the work my sir!
Yeah, the Nano was great for experimenting but not enough memory for much else. The Xavier is a lot better and I can't wait to get my hands on an Odin!
@@kerseyfabs Ouu yee. Thats a great idea. This is where a helmet like this comes in handy. Maybe a project a bit like from the Street Hawk series or the RoboCop 2019 movie (badass helmet design). I'm a motorcyclist and 3D designer (also deals with 3D printing), I've often thought of a similar idea. HUD display in the helmet, and switches under the thumb at the handle - unless voice control, as in some intercoms. It's better to have a GPS notification on the helmet display than to poke around in the phone while driving. GPS gauges, message notification and maybe even readings from the machine itself; there is certainly something to put in such an interface, but the truth is that it must be quite minimalistic. What if Jarvis found a detour and said "Sir. I found a shorter way?" Cool thing.
so, you want to have an update feature so it can change the simple "car" label later. so, it sends the "car" info to a remote server, and the info from that search is listed. could do the same for adding a label to people, to look up your friends list on Facebook or something :P but, adding the rest of the armor, you will have more room for more computation, and cooling options. hell, having the hottest part on your back with fans blowing out vent ports as if you are trying to fly off, would be a fun gimmick for cons. taking advantage of ar glasses may be your next step. using the transparent displays will give you real time and batt independent view of the world around you, while also giving you the gui hud you want. along side the option of remote computations and search handling, you should be able to get even closer to true iron man hud tech, using those cameras for zoom options, along side the recordings for youtube.
If you used some micro cameras like a VR headset does, you could add hand tracking so you could do some sort of hologram 3d workspace within the helmet like Iron Man did. Might take a while to get down but just a thought anyway. It would also be really cool if you added some sort of eye tracking like the Apple headset, a code similar to the OpenCV Laser Point Tracking system, this way it would only identify objects that your looking at, saving the computer some effort and making it less crowded and more able to hold up the tracking part of the display instead of it cutting in and out. But, my addition ideas aside, this was really awesome, best video I have ever seen.
I've got to say, that is absolutely amazing! From having a concept/idea to making it a reality. Keep wishing you the best in all your future endeavors and am glad I stuck with you since the beginning. I look foward to your future content, always have and always will. Laughed at the end when the kid said, ain't you suppose to be dead.
That is so amazing and really shows how amazing and talented a real-life Tony Stark would be in figuring out how to fit all those electronics in such a small space and make it work wirelessly.
Ive been wanting to do a gundam cosplay with a HUD system just like this. The fact that you will make this available for others to use actually motivates me to actually plan out doing this now rather than what my original plans were gonna be.
Not me watching this thinking... halo fans and iron man fans are in a race to make functional suits. This guy already has the HUD down, and Alex Labs has the arc reactor and repulsor tech down... For halo, Installation00 has the helmet working already. Now we just have to wait and see which side makes a complete suit first
Congratulations on the success of this build, I'm absolutely blown away by how awesome the helmet and the amount of tech you were able to squeeze into such a small space. I want one so much to add to my collection even it means more ear ache from the wife it would be so worth it big love from Ireland can't wait to see how your creation evolves
You did it, you did it! In theory with the field of vision you now have you should be able to walk around with the helmet without problems, the only additions you could make are microphones on the sides to hear well since the helmet encapsulates your head and cutting the sounds, then if you want you could insert a microphone and a speaker to make your voice heard and add effects if you want. I too have the dream of realizing this project, to save space horizontally in the helmet, I had thought of positioning the screens at the bottom of the mask pointing upwards with the lens above, then positioning two mirrors in front of the eyes at an angle of 45 ° so that they reflect the images of the screens, if desired the mirrors could be rotated so that when the system is off you can still see through the slots on the mask. As for additional information, you could insert a function that tracks where you are looking and then provides you with the data and information without filling your field of view too much Think with the technology of next generation viewers how compact all this can be, the only difficulty will be hiding the cameras.
Sorry for taking so long to reply Drew but you had a very thoughtful comment and I wanted to reply to your thoughts! The microphones and speakers were ideas I've had and I may implement them relatively soon. The mirror idea is interesting but I'm not 100% sure how it could save space. I'll do some research/thinking on it. Eye tracking is on my wish list but it requires additional cameras. Hiding the cameras is a work in progress. Thanks again for the feedback!
2:40 lmao forgot about that part. There’s something so satisfying about watching 1) someone else work and 2) seeing an entire two years boiled down into a 30 minute video. Absolutely fantastic. I commend you on your efforts. I also realize, thanks to you, how much engineering you put into the (more than just a) helmet. I’m also amazed at the breadth of your skill level. Thanks for sharing this. I was particularly interested in how you developed the GUI, nice job J6. You guys killed it.
LET'S FUCCIN GOOOOOOO!!!! Just started planning a similar idea to this but more Cyberpunk inspired! You've done me an amazing service with this video sir.
@@kerseyfabs I’m going to start with getting the basics up and running, but I’d like to add IR optics as well! I was super impress with your video showcasing the new nano so I’ll probably use the new NX to see what kind of hardware encoding it can do. While im not *super* concerned about recording, it would be awesome to just have that extra headroom
This absolutely rocks. You should put the screen that shows what you are seeing on your back so when you are walking about people behind you can see that you’ve done an absolutely awesome job.
It is absolutely phenomenal. The only thing is the helmet sticks out from your face a little bit but that doesn’t detract from how amazing this is. Do you plan to make a full suit with this thing?
I can’t wait for you to release this so we can see what the community does with it! You are just one person that has come this far imagine what a whole community can do with your work as the base.
I can definitely see this taking off. Like this could be militarized. With the a huge amount of funding and a awesome team behind this. This could be the start of a real life hero.
As many super hero (Iron Man/Spider man) video projects I have seen, this one is by far the best and most interesting one I have watched to this day. I have no clue how to build such things so watching someone else do it brings me much happiness. Good job. I will be watching.
"IRONMAN...! I thought you were dead..." 😂😂😂 I scared my upstairs, elderly neighbor cause that caused me to break out in a loud, barking laughter - he thought a vicious dog had got in my house. LOL! Your work with that tech is just astonishing! I'm working on a Mandalorian helmet (just Mandalorian in general - not THEE Mandalorian) and this video has me wondering how I could incorporate a HUD like yours into my own bucket. Thank you for the video! Subbed!
Ngl, I've had that idea for years ever since I got my first VR but I never actually did anything so seeing how similar your project was to what I envisioned makes me proud in a "I wasn't too far off" way
You have completely inspired me good Sir! This is absolutely amazing, I always had a sneaking suspicion that this technology was possible. Thank you for paving the way.
im blown away! this is truly magical.. great work!! i never thought i could see smthn like this you really deserve a lot more attention. and is there a way to like join those 2 cams like how our eyes work? cuz now both displays show the same thing.. this thing is really incredible and im sure you're gonna keep on making this better and i wish you all the best with it!!
Thank you! The displays are not identical. They are offset by a few inches. You can see the cameras on the front of the helmet. This does give you 3D vision.
@@kerseyfabs wow i never thought would get a reply from you.. thank you sm! YK the GPS and other info is seen on both the screens which makes it feel like its mirrored.. in my opinion removing the GPS from left and battery stuff from the left side and removing the side compass and the blue box from right and making the top compass into one could make it look more real.. just my opinion i mean this is so cool as it is and implementing more stuff into it can make it so much more cool!
I think this is the best thing I've ever seen on RUclips you're a fricking legend dude, I would love to see someone with the reactors attached to their hands, the full armor and your helmet this would be insane
Random idea, have fake 3d graphics like doom uses, but instead of the vertical axis, be the horizontal one, ie: the one inline the direction you are facing. Headache is too much to think it out more. Also perhaps if put a lcd ontop another lcd you can have the bottom show the environment and the top show any computer stuff to avoid lag, makers muse did a dual lcd layer for different reasons but it is a good demo of what it is.
Man it's like seriously marvellous move ... People can't even easily fit something in that shape but you did and made world's first real iron man helmet
Soon everything will be upgraded and seamless, like the display being one screen vs two and higher memory running to help prevent crashes. This would be really fun to keep an eye on and see what you do for upgrades.
YESS this is what I always wanted to see. I've been looking for something like this for 4 months now!! RRespect cant wait to see the updates & Upgrades
Wow! It's absolutely incredible. I'm looking forward to v2. Perhaps some curved screens to reduce/eliminate the lenses and space needed. Also, what about some airflow channels to reduce heat inside the helmet? Nothing crazy like an A/C unit. Just a small fan (an inch or two dia.) to push air through. Another thought...what about using a similar system that cars use to see around the vehicle, to increase field of vision? Like the 'Fish Eye' cameras on the side mirrors that then use software to unbend the image for display?
Thanks Allen! I have a curved display on the way as a potential upgrade. I don't think it will eliminate the need for lenses though as our eyes are not great at a few centimeters from the display. So far I haven't needed fans in the helmet but, as we get back into warmer weather, I'll consider it. Right now people are already complaining about the cameras, so I don't think I'll add extra ones yet but I do love the idea of doing the warped wrap around. My vehicle has that and it's very cool!
I coined you your genius, when you noted putting everything in a PDF for others. That’s what I call a worthy channel to watch & progressive planning. Due to the fact that even if it was just for yourself you wouldn’t have to waste time revisiting your writing to code once again. I actually have been thinking of doing something similar myself although I love originality so I’d have to conceive a mask worthy to bring in reality. I’ll have to take you up on your programming never has it been my strong suit. Men like you are few Continue, Continuing on your legacy champ
I really appreciate all of that. I'm glad I can share all of this and that there are people interested in the details of the project. I'm still working on some details behind the scenes before I release the code but it's coming.
me from 2 years ago would be fainting from excitement. I was at the height of my Iron man phase. Now, I my interest in Iron man is resurfacing. I've always thought a helmet with a HUD would be the coolest thing, and it's so cool to see you just completely going for it, and making it as close as possible to the movies
Thank you! I never lost sight of the dream. I really wanted to take what Hacksmith did to the next level. It just took some time. There's more to do still!
Hey, awesome project, I really like what you made, keep it up! Also, there are a few ideas that came to my mind while watching. I don't want to sound like I know everything better, because I simply don't but maybe, they might help anyways: So my approach for the latency and consistency would be, to display the image as soon as you get it (or use a transparent display/a non-obstructing display method). The HUD elements on the other hand you will display as you get them. That means you can use as much time for the Image Recognition and possible database stuff as you need (also try to hide database work behind animations instead of loading indicators). What this also allows you to do, is to run these operations at different framerates, for example, you can have the HUD at 30 FPS and the "World" at 60 FPS. Further, you could make the Image recognition at something like 10 FPS and giving it more time, a bigger database ob objects, a connected database for additional information or what ever else. Since you still need to update the UI Elements at more than 10 FPS, you can try to figure out, how relevant objects in the World are moving and create a Vector Space out of that data. Using that you can move the UI elements between frames with image recognition. These are all just wild Ideas that take a lot of effort to develop and code. Also, they possibly need a friggin lot of performance. So maybe this isn't even possible, tho we will only find out, by testing... I also have some more Ideos regarding the Usability of the Interface and stuff, but since they will probably only be reasonably interesting after a few more revisions, I will keep them for myself (for now). Again, this Project is amazing and you can really be proud of what you achieved. Keep it going
You started this on October 27th, 2020?!?! That was 10 days after my 31st Birthday. I'm 33 now, and this is an incredible dent in a very complicated system! excellent job!
It's already possible using the AR tech available on Amazon. Hologram tech was simply used in the movie so audiences could see it, when tbh, the more accurate & tech involved version would be basic AR style with eye tracking. Much more compacted, but far more immersive.
I get what you're talking about. I've seen what's available off the shelf. The biggest problem with transparent tech is that visibility is incredibly bad in the helmet. If you have full lighted eyes, that hinders your vision. Plus, the eye holes are very small and offer very little peripheral vision in any direction. You can see in Iron Man 1 that when the helmet goes dark, his visibility isn't the same. Second, I don't know any of the off the shelf products that have an open API that would allow you to code your own UI or applications.
I am gobsmacked. This is exactly what I’ve wanted to build since the first Ironman film. You have done amazing work. I have a couple of ideas which I would be happy to share with you, if you are interested. I know no one else has done them and I think you would have the skills to do them
That´s how it starts. Just as a lot of tech we have today were inspired by Star Trek, imagine 40 years from now. An you are already there. I hope I live this long to see it.
You have certainly done a lot of heavy lifting on the way to a real useful AR . I love that you focused on the practical application of existing and emerging technology. I have had an idea for some time now that would run parallel to your project . If I can make some headway, I would love to share it with you. Meanwhile, thanks for shooting this and taking all the time to get it out to us. I know it is not as easy as breathing. In fact there is a ton of work that clearly went in to all of this. I am impressed.
Maybe a 9DOF on your left wrist that has an input system overlayed to the HUD as a GUI that moves with your wrist. Then cameras detect your right hand as the input peripheral. Seriously incredible build. Thank You for sharing the journey! Can't wait for more...
I love the idea. With the repulsor video I just put out, it ties in perfectly. There are some even newer sensors too with amazing sensor and gesturing ability.
Since you have a controller, and half the software working, I'd recommend way toning down the object highlight, with maybe a thin red line, that is semi transparent. Then with the center reticle, you could select the object for more details which would simplify kicking off the search for car model and such by taking a quick screen cap, and reverse image searching. It would make the object recognition way less overwhelming also. My UI recommendations are that, and allowing for more transparency. I'm going to presume eye tracking is going to be hard if implemented at all but if it is, fade things out to semi transparent when not looking at it, like the map in particular.
Thanks for the advice! I am working on eye tracking and it will be one of the next major features. I think that will make me rework the entire design. For now, I did completely disable object recognition and I'll be reintegrating it more intelligently. The initial design was for proof of concept and this tech demo.
@@kerseyfabs Radical! I'm excited to see where this goes. This was such a cool video and makes me hopeful for actual AR, at least for cosplay. I can imagine, with some AC, this being genuinely useful at a con given some setup for booth locations or hotel maps etc. It's just sick af man!
This is so cool! As a fellow SWE I would love to see more of the software side, all of it! Especially the gstreamer and Ui elements! Such an inspiration, thanks!
Good to hear from you Tim(othy)! I'm working on a complete open source release and I get closer all the time. Keep an eye out on this channel for more information.
Nice work , I like it ! idea that I would like to share as object detection is messy in real word / outside, you should : 1- Display only one object. 2- Display the object that appears in a specific spot / angle and track only one object at a time. 3- Display object detection animation in a static / specific / same spot of screen . Looking forward to see how you will iterate the design and optimize portability (Energy/ batteries + Compute Power ) = heat management :) good luck !
I appreciate it! I'm going to replacing the current per frame object detection with proper object tracking. This was just the simplest to implement. Thanks for the ideas!
I haven't much (any) idea of how it all works but that flashing (on, off, on, off, on) with object detection seems annoying. I wonder if a small delay before turning the hud element off to wait and see if it regains a high enough detection percentage would make the experience a lot nicer. I suppose it would be hard for it to tell if it is the same object but I think it'll be the better of the options...
Yeah, I already have several ideas to smooth the object tracking. I'll fix it in a future version. I could only do so much in version 1 and still get this released.
26:30 When you want the HUD like Iron Man, but you see the tall, daunting task of making it. Wow. You have more patience than me! I love tech, but I'm more of an artistic type of guy. I hope one day these components can be more compact. 27:15 You're local?! Wow! 29:30 I heard that record player scratch sound fx and thought, " Hey at least that kid saw "Endgame"." Whelp, time to get back to work! Great video.
Thank you to everyone for watching and taking the time to leave such kind words about the project! I'll have some more information on the channel very soon!
To add vehical information you could possibly send the images to a database of cars and have it figure out what kind of car it is, it would be cool to have a version of ChatGPT and figure out a way to interact with the helmet controls in place of Jarvis, but great job thats looks so freaking cool
I wonder if this would be possible in all metal with a possible suit
I have an all metal helmet that I'll be working towards. 😉
All in the works! Thanks!
this is really cool
This is awesome!!!
Thank you for watching! It means a lot!
Something id expect from you guys. His build is dope being contained in the arc tho!
Glad to see you about James!! Keep up the fight! You’re a winner!! You’re your own hero!!
I bet you could do this Hacksmith
Hire him
A MAD MAN AT WORK. one of the coolest things I’ve seen 👏🏻
Thanks Emily! I really appreciate it!
Could you possibly put a small camera in the helmet to provide retina tracking so as to sync it up to the object detection? This should be an easy mod for you and it would add stability to the system in large open areas. Great video btw!!
Yes! It's on my very long to do list! Thanks for the suggestion. Glad you enjoyed it!
What is an example or use case, cool idea.
It’d take too much memory to build a database of any possible object that object detection could lock on to. Maybe instead could pair it up to google images and maybe a simple AI like alexa to display relevant info
Yeah you could also lower the opacity and size of the UI elements and maybe lower the resolution of them then blur it so you don’t notice, so that you can see more, but when you look at one it will get bigger and come to full opacity. As another comment said you could use an AI such as GPT-3 and display relevant info of an object using Google. You could also add interactivity to the UI e.g have it so you can look at something and blink twice to select it. This could also allow you to easily toggle object detection on and off when you do/don’t need it which could help with performance. Another thing that could help with performance is using foveated rendering to lower the quality of the screen if it is in your peripheral vision, where it is already blurry to you.
You mean iris detection????
You do realize that you basically just made your own VR headset, right?
Very awesome stuff. I had brain-built something like this, but wasn't able to put the time, money, or skill into it. You did a WAY better job than I could have, and not only am I impressed, but hugely thankful that you took this to stratospheric levels. I can't compliment you enough!
Thanks Jake! I really appreciate the feedback. Yeah, it turned into a real VR/AR project and come March, it's going to get crazier!
Time and money are the worst. 😂
well it would be AR
@@Sa0lgoodman Which is so much cooler and more useful. There's so much cool software that can be added here like he said.
Once in a while, youtube recommendations actually produce some gold. This is one of those times. Excellent build and I look forward to see further advancements and features to be incorporated into the design!
Thank you so much! I'm glad you found the channel and enjoyed the content!
This is great!
I always felt like the Iron Man suit (at least early versions) did eye tracking to see where Tony was looking. If you could get that implemented then you could be more specific over object detection and potentially use it as a control interface. In fact, a button in the suit glove and eye tracking should be plenty to control it without having to hold that keypad up to your face.
Thanks for the suggestion! It's on my list and I'll work on it in version 2 or 3.
I would imagine you also want your “Jeeves” to provide you with queues on what you’re not currently looking at. That’s more proactive than reactive. IMO, getting stable and reliable output from the object detector is more important. Just my cents (by the way, what happened to the cents symbol on my phone keyboard).
This is so freakin cool!!!!
Thanks Frank!
Kris, I saw the time on this - over 30 minutes - at the end, I could not believe how fast it went, you did a fantastic job designing , building, programming and testing.
This is a project you are justifiably proud of and will be fun to follow as it continues to develop
Thank you David! That means a lot to me as a content creator! This was a labor of love.
@@kerseyfabs I know 2022 has been a difficult year for you hope 2023 is better, this should attract many new viewers!
i didnt even realize it was 30!
@@alexanderatg6588 I really appreciate that!
The fact that you could fit all that inside the helmet is just crazy! That's so tight! And you even manage to not make the eye looks weird! This is next level
Thank you! It seems everyone has different opinions about the eyes. For some people they stand out and for others they don't. I think it matter a lot how close you are.
@@kerseyfabs As someone who's in the process of converting a premade display prop Halo Spartan helmet into essentially this, fitting it all in has been hours and hours of dremelling and 3D printing adapter mounts/plates for everything. Definitely gonna take some notes from your work and see if i can revisit my internal layout !
@@StormBurnX Awesome! Good luck with your build!
This is by far the most impressive iron man helmet I've ever seen. You definitely need more views
I appreciate the watch and comment! I'm trying to get the word out! 😀
Chris you should be so proud of your accomplishments! Thank you for sharing your experience and proving this is possible. I'm so inspired to do this with my builds now!
Thank you so much! Keep reaching!
Great job! For the lag :You can split the video with hardware right at the camera's output. From the split section you connect your video directly to the output mixer as background( hardware again). From the second split section you feed into your computer and retrieve only the interface. Project the interface on top by connecting to the output mixer. This will give you a live feed without lag. The only lag that can possibly exist, will be at the interface.
There's only a 20ms lag plus this allows me to record what I'm seeing without any additional hardware. Thanks for the ideas!
Thank you for sharing this project in all details!
Always! Thanks for dropping the comment!
the fact that more people trying to approach utilitarian perspective where it "actually" works. and not just gimmick is what's going to advance human technology to next level. Keep up the work my sir!
Thank you! Making it work for real is the best part! Gimmicks are fun and all but seeing it do what it was meant to do real time is so cool!
Jetson Nano-Half the power of the Nintendo Switch, in the palm of your hand!
Now, the Xavier NX, on the other hand, is kinda nuts.
Yeah, the Nano was great for experimenting but not enough memory for much else. The Xavier is a lot better and I can't wait to get my hands on an Odin!
A brilliant case for a motorcycle helmet when your hands are full. These helmets are the future. Great design.
Thank you! I've thought about making one. Should I work on it?
@@kerseyfabs Ouu yee. Thats a great idea. This is where a helmet like this comes in handy. Maybe a project a bit like from the Street Hawk series or the RoboCop 2019 movie (badass helmet design). I'm a motorcyclist and 3D designer (also deals with 3D printing), I've often thought of a similar idea. HUD display in the helmet, and switches under the thumb at the handle - unless voice control, as in some intercoms. It's better to have a GPS notification on the helmet display than to poke around in the phone while driving. GPS gauges, message notification and maybe even readings from the machine itself; there is certainly something to put in such an interface, but the truth is that it must be quite minimalistic. What if Jarvis found a detour and said "Sir. I found a shorter way?" Cool thing.
Outstanding. If this is made available I’m 100% putting this in my helmet
Awesome! I hope you do! I'm still working on the release.
so, you want to have an update feature so it can change the simple "car" label later. so, it sends the "car" info to a remote server, and the info from that search is listed. could do the same for adding a label to people, to look up your friends list on Facebook or something :P
but, adding the rest of the armor, you will have more room for more computation, and cooling options. hell, having the hottest part on your back with fans blowing out vent ports as if you are trying to fly off, would be a fun gimmick for cons. taking advantage of ar glasses may be your next step. using the transparent displays will give you real time and batt independent view of the world around you, while also giving you the gui hud you want. along side the option of remote computations and search handling, you should be able to get even closer to true iron man hud tech, using those cameras for zoom options, along side the recordings for youtube.
If you used some micro cameras like a VR headset does, you could add hand tracking so you could do some sort of hologram 3d workspace within the helmet like Iron Man did. Might take a while to get down but just a thought anyway. It would also be really cool if you added some sort of eye tracking like the Apple headset, a code similar to the OpenCV Laser Point Tracking system, this way it would only identify objects that your looking at, saving the computer some effort and making it less crowded and more able to hold up the tracking part of the display instead of it cutting in and out. But, my addition ideas aside, this was really awesome, best video I have ever seen.
I’d LOVE to fly my paramotor while wearing that thing! (Or take you as a passenger)
Dude! That would be incredible! Would it be alright if I drop you an email?
I've got to say, that is absolutely amazing!
From having a concept/idea to making it a reality.
Keep wishing you the best in all your future endeavors and am glad I stuck with you since the beginning.
I look foward to your future content, always have and always will.
Laughed at the end when the kid said, ain't you suppose to be dead.
Thank you so much! I appreciate your support and I'm glad you enjoyed it!
Sir you are a true Engineering hero an inspiration to many and a hardworking genuis. This is perfect ❤❤
Thank you so much!
That is so amazing and really shows how amazing and talented a real-life Tony Stark would be in figuring out how to fit all those electronics in such a small space and make it work wirelessly.
Thanks! Yeah, he did a lot in a very short amount of time. Having the resources of a multi-billionaire helped too though.
Whoa! Amazing. A rear view camera and a speaker for vocal projection would be dope..
All in due time... Thanks!
Ive been wanting to do a gundam cosplay with a HUD system just like this. The fact that you will make this available for others to use actually motivates me to actually plan out doing this now rather than what my original plans were gonna be.
Yes please, ask him to do a collab
I'm working on some of the details and new hardware now!
@@kerseyfabs thats exciting! will there be some sort of update video showing off any changes?
@@knightdaiguren3208 Absolutely! More videos coming soon!
Not me watching this thinking... halo fans and iron man fans are in a race to make functional suits. This guy already has the HUD down, and Alex Labs has the arc reactor and repulsor tech down... For halo, Installation00 has the helmet working already. Now we just have to wait and see which side makes a complete suit first
Heh... hint: we're working together to a certain extent. I'm involved with the Installation00 team. One day there may be some integrations.
This is insanely amazing! Looking forward to the technical details of this incredible journey!
Thanks Tony! Coming soon!
YES YES YES SOMEONE FINALLY DID IT!!!!! AWSOME WORK DUDE!
Dude! I appreciate it!
You are Really a genius, please write to this management what parts you put there and how you created the program and so on
Congratulations on the success of this build, I'm absolutely blown away by how awesome the helmet and the amount of tech you were able to squeeze into such a small space. I want one so much to add to my collection even it means more ear ache from the wife it would be so worth it big love from Ireland can't wait to see how your creation evolves
Thanks a ton!
That’s a masterpiece! I really enjoyed watching the entire process from the idea to the implementation! Keep it up!!
Thanks! It was really a lot of fun to put it together. A very different process than my usual video.
This is absolutely amazing! I never thought that something like this is even possible. Great job!!
Thank you for that! Cheers!
You did it, you did it!
In theory with the field of vision you now have you should be able to walk around with the helmet without problems, the only additions you could make are microphones on the sides to hear well since the helmet encapsulates your head and cutting the sounds, then if you want you could insert a microphone and a speaker to make your voice heard and add effects if you want.
I too have the dream of realizing this project, to save space horizontally in the helmet, I had thought of positioning the screens at the bottom of the mask pointing upwards with the lens above, then positioning two mirrors in front of the eyes at an angle of 45 ° so that they reflect the images of the screens, if desired the mirrors could be rotated so that when the system is off you can still see through the slots on the mask.
As for additional information, you could insert a function that tracks where you are looking and then provides you with the data and information without filling your field of view too much
Think with the technology of next generation viewers how compact all this can be, the only difficulty will be hiding the cameras.
Sorry for taking so long to reply Drew but you had a very thoughtful comment and I wanted to reply to your thoughts!
The microphones and speakers were ideas I've had and I may implement them relatively soon.
The mirror idea is interesting but I'm not 100% sure how it could save space. I'll do some research/thinking on it.
Eye tracking is on my wish list but it requires additional cameras.
Hiding the cameras is a work in progress.
Thanks again for the feedback!
2:40 lmao forgot about that part. There’s something so satisfying about watching 1) someone else work and 2) seeing an entire two years boiled down into a 30 minute video. Absolutely fantastic. I commend you on your efforts. I also realize, thanks to you, how much engineering you put into the (more than just a) helmet. I’m also amazed at the breadth of your skill level. Thanks for sharing this. I was particularly interested in how you developed the GUI, nice job J6. You guys killed it.
Thanks for all the feedback! I'm glad you enjoyed the video. It may have been harder to produce than the helmet. 😆 Cheers!
LET'S FUCCIN GOOOOOOO!!!! Just started planning a similar idea to this but more Cyberpunk inspired! You've done me an amazing service with this video sir.
Thank you so much! Can't wait to see what you make!
@@kerseyfabs I’m going to start with getting the basics up and running, but I’d like to add IR optics as well! I was super impress with your video showcasing the new nano so I’ll probably use the new NX to see what kind of hardware encoding it can do. While im not *super* concerned about recording, it would be awesome to just have that extra headroom
Wow, despite the external help you are the truly Tony Stark in real life.
Thank you so much!
Brooo, this is dope! … I can’t wait to see the whole suite assembled 😎👍✨
Thank you! Helmet upgrade video coming very soon! With AI!
@@kerseyfabs Man I am sooo there! 💯👈🤩
bro deserves so much more!
I appreciate that! New build in the works!
@@kerseyfabs cannot wait!
I LOVE this. Awesome stuff, Kris!
There's something about Tony Stark having a fanny pack that feels right.
This absolutely rocks. You should put the screen that shows what you are seeing on your back so when you are walking about people behind you can see that you’ve done an absolutely awesome job.
I think it being on my back would take away from the cosplay a bit but I do have the one we can carry around.
It is absolutely phenomenal. The only thing is the helmet sticks out from your face a little bit but that doesn’t detract from how amazing this is. Do you plan to make a full suit with this thing?
Thanks and you're right on both counts. Yes, I'm currently working on the full suit with a lot of upgrades.
@@kerseyfabs that is awesome dude and I can’t wait to see it
This is CRAZY awesome! Great job!
Thank you! Cheers!
I can’t wait for you to release this so we can see what the community does with it! You are just one person that has come this far imagine what a whole community can do with your work as the base.
ruclips.net/user/shortsiqjbmHYmVuo?feature=share
Thanks! I hope I get a lot of contributions to make it awesome!
"Hey Ironman I thought you were dead?"
Too soon. 😭😭😭😭
I live! 😆😎
next tony stark
This gives me fuel my friend!
I can definitely see this taking off. Like this could be militarized. With the a huge amount of funding and a awesome team behind this. This could be the start of a real life hero.
While I'm not all into the militarization, I'm definitely going to be developing this further!
As many super hero (Iron Man/Spider man) video projects I have seen, this one is by far the best and most interesting one I have watched to this day. I have no clue how to build such things so watching someone else do it brings me much happiness. Good job. I will be watching.
Wow, thank you! I'm glad you enjoyed it!
"IRONMAN...! I thought you were dead..." 😂😂😂 I scared my upstairs, elderly neighbor cause that caused me to break out in a loud, barking laughter - he thought a vicious dog had got in my house. LOL! Your work with that tech is just astonishing! I'm working on a Mandalorian helmet (just Mandalorian in general - not THEE Mandalorian) and this video has me wondering how I could incorporate a HUD like yours into my own bucket. Thank you for the video! Subbed!
This would be a pile of fun tied into an FPV system for a drone.
Yeah! I've thought of a couple of cool remote viewing ideas like that.
Ngl, I've had that idea for years ever since I got my first VR but I never actually did anything so seeing how similar your project was to what I envisioned makes me proud in a "I wasn't too far off" way
That's awesome! Thanks for watching!
"I thought you were dead!" 🤣🤣🤣
Thanks for sharing the behind the scenes on your awesome build.
Absolutely! Glad you enjoyed it!
You have completely inspired me good Sir! This is absolutely amazing, I always had a sneaking suspicion that this technology was possible.
Thank you for paving the way.
Thank you for the kind words! All of the source is now available! oasisproject.net/
Man deserves fame
Thank you again! 😀
im blown away! this is truly magical.. great work!! i never thought i could see smthn like this you really deserve a lot more attention.
and is there a way to like join those 2 cams like how our eyes work? cuz now both displays show the same thing.. this thing is really incredible and im sure you're gonna keep on making this better and i wish you all the best with it!!
Thank you! The displays are not identical. They are offset by a few inches. You can see the cameras on the front of the helmet. This does give you 3D vision.
@@kerseyfabs wow i never thought would get a reply from you.. thank you sm! YK the GPS and other info is seen on both the screens which makes it feel like its mirrored.. in my opinion removing the GPS from left and battery stuff from the left side and removing the side compass and the blue box from right and making the top compass into one could make it look more real.. just my opinion i mean this is so cool as it is and implementing more stuff into it can make it so much more cool!
Kris,
This is truly amazing!
I’m very impressed!
Thank you! I'm glad you enjoyed it!
I think this is the best thing I've ever seen on RUclips you're a fricking legend dude, I would love to see someone with the reactors attached to their hands, the full armor and your helmet this would be insane
The repulsors for the hands are coming! Maybe not fully functional but I'm proud of how they look!
Hands down, this is the coolest project I've seen in my life
You made my morning! Thanks for that! Cheers!
Random idea, have fake 3d graphics like doom uses, but instead of the vertical axis, be the horizontal one, ie: the one inline the direction you are facing. Headache is too much to think it out more. Also perhaps if put a lcd ontop another lcd you can have the bottom show the environment and the top show any computer stuff to avoid lag, makers muse did a dual lcd layer for different reasons but it is a good demo of what it is.
Man it's like seriously marvellous move ... People can't even easily fit something in that shape but you did and made world's first real iron man helmet
Thank you so much! Cheers!
Soon everything will be upgraded and seamless, like the display being one screen vs two and higher memory running to help prevent crashes. This would be really fun to keep an eye on and see what you do for upgrades.
YESS this is what I always wanted to see. I've been looking for something like this for 4 months now!! RRespect cant wait to see the updates & Upgrades
Thanks for watching! I really appreciate it!
Wow, really impressing. Fantastic work.
🙏 Thank you!
Wow! It's absolutely incredible. I'm looking forward to v2. Perhaps some curved screens to reduce/eliminate the lenses and space needed. Also, what about some airflow channels to reduce heat inside the helmet? Nothing crazy like an A/C unit. Just a small fan (an inch or two dia.) to push air through.
Another thought...what about using a similar system that cars use to see around the vehicle, to increase field of vision? Like the 'Fish Eye' cameras on the side mirrors that then use software to unbend the image for display?
Thanks Allen! I have a curved display on the way as a potential upgrade. I don't think it will eliminate the need for lenses though as our eyes are not great at a few centimeters from the display. So far I haven't needed fans in the helmet but, as we get back into warmer weather, I'll consider it.
Right now people are already complaining about the cameras, so I don't think I'll add extra ones yet but I do love the idea of doing the warped wrap around. My vehicle has that and it's very cool!
@@kerseyfabs I didn't mean to sound as if to say to add more cameras, just to replace them with ones that have the wider FOV.
@@Raniko2020 Ahh! Maybe eventually. To do that properly I'd have to add a lot of distortion compensation. More processing!
This is so cool AF, tony would be proud!
Thank you so much! 👊
I coined you your genius, when you noted putting everything in a PDF for others. That’s what I call a worthy channel to watch & progressive planning. Due to the fact that even if it was just for yourself you wouldn’t have to waste time revisiting your writing to code once again. I actually have been thinking of doing something similar myself although I love originality so I’d have to conceive a mask worthy to bring in reality. I’ll have to take you up on your programming never has it been my strong suit. Men like you are few Continue, Continuing on your legacy champ
I really appreciate all of that. I'm glad I can share all of this and that there are people interested in the details of the project. I'm still working on some details behind the scenes before I release the code but it's coming.
me from 2 years ago would be fainting from excitement. I was at the height of my Iron man phase. Now, I my interest in Iron man is resurfacing. I've always thought a helmet with a HUD would be the coolest thing, and it's so cool to see you just completely going for it, and making it as close as possible to the movies
Thank you! I never lost sight of the dream. I really wanted to take what Hacksmith did to the next level. It just took some time. There's more to do still!
@@kerseyfabs I love that a lot of the things from the movies are possible in real life, as long as you have the right components
Hey, awesome project, I really like what you made, keep it up!
Also, there are a few ideas that came to my mind while watching. I don't want to sound like I know everything better, because I simply don't but maybe, they might help anyways:
So my approach for the latency and consistency would be, to display the image as soon as you get it (or use a transparent display/a non-obstructing display method). The HUD elements on the other hand you will display as you get them. That means you can use as much time for the Image Recognition and possible database stuff as you need (also try to hide database work behind animations instead of loading indicators). What this also allows you to do, is to run these operations at different framerates, for example, you can have the HUD at 30 FPS and the "World" at 60 FPS. Further, you could make the Image recognition at something like 10 FPS and giving it more time, a bigger database ob objects, a connected database for additional information or what ever else. Since you still need to update the UI Elements at more than 10 FPS, you can try to figure out, how relevant objects in the World are moving and create a Vector Space out of that data. Using that you can move the UI elements between frames with image recognition.
These are all just wild Ideas that take a lot of effort to develop and code. Also, they possibly need a friggin lot of performance. So maybe this isn't even possible, tho we will only find out, by testing...
I also have some more Ideos regarding the Usability of the Interface and stuff, but since they will probably only be reasonably interesting after a few more revisions, I will keep them for myself (for now).
Again, this Project is amazing and you can really be proud of what you achieved. Keep it going
You have a lot of great ideas here! Stay tuned for future video where I talk about some of these.
This is so cool, I’ve always wondered if it was possible to fit all that in a helmet. The kid’s “I thought you were dead” made me burst out laughing!
Yeah, hanging out and getting random reactions is a lot of fun!
Such an AWESOME job!! Loved how you put this together!!
Thank you! Cheers!
You started this on October 27th, 2020?!?! That was 10 days after my 31st Birthday. I'm 33 now, and this is an incredible dent in a very complicated system! excellent job!
Happy belated birthday! LOL Thank you!
It's already possible using the AR tech available on Amazon. Hologram tech was simply used in the movie so audiences could see it, when tbh, the more accurate & tech involved version would be basic AR style with eye tracking. Much more compacted, but far more immersive.
I get what you're talking about. I've seen what's available off the shelf. The biggest problem with transparent tech is that visibility is incredibly bad in the helmet. If you have full lighted eyes, that hinders your vision. Plus, the eye holes are very small and offer very little peripheral vision in any direction. You can see in Iron Man 1 that when the helmet goes dark, his visibility isn't the same. Second, I don't know any of the off the shelf products that have an open API that would allow you to code your own UI or applications.
I am gobsmacked. This is exactly what I’ve wanted to build since the first Ironman film. You have done amazing work. I have a couple of ideas which I would be happy to share with you, if you are interested. I know no one else has done them and I think you would have the skills to do them
Thanks! If you have ideas, please feel free to share them here or send me a message on any social media platform.
I think adding an infrared camera to the device could help it differentiate some of the objects and people. But project is very good
I actually have an infrared module I've written code for but that's a future video! Thanks for commenting!
Kudos, watching this totally got me pumped!
Thanks for the inspiration.
I'm happy I could do it!
this project is gonna be INSANE! been wanting to see something like this for ages. thanks for taking the first steps!
You bet! Thanks for following along!
This is the best project I have seen❤❤Hates off to you sir. And one more thing can you make for Spidey
Thank you! Maybe a Spidey HUD in the future!
That´s how it starts. Just as a lot of tech we have today were inspired by Star Trek, imagine 40 years from now. An you are already there. I hope I live this long to see it.
Yep! Looking to SciFi is a great source of inspiration!
You have certainly done a lot of heavy lifting on the way to a real useful AR . I love that you focused on the practical application of existing and emerging technology. I have had an idea for some time now that would run parallel to your project . If I can make some headway, I would love to share it with you.
Meanwhile, thanks for shooting this and taking all the time to get it out to us. I know it is not as easy as breathing. In fact there is a ton of work that clearly went in to all of this. I am impressed.
Thanks! It's been a fantastic project and I've been very pleased with the response.
Maybe a 9DOF on your left wrist that has an input system overlayed to the HUD as a GUI that moves with your wrist. Then cameras detect your right hand as the input peripheral.
Seriously incredible build. Thank You for sharing the journey! Can't wait for more...
I love the idea. With the repulsor video I just put out, it ties in perfectly. There are some even newer sensors too with amazing sensor and gesturing ability.
@@kerseyfabs I watched the repulsor one last night after this one and thought it might tie in nicely with that!
Since you have a controller, and half the software working, I'd recommend way toning down the object highlight, with maybe a thin red line, that is semi transparent. Then with the center reticle, you could select the object for more details which would simplify kicking off the search for car model and such by taking a quick screen cap, and reverse image searching. It would make the object recognition way less overwhelming also.
My UI recommendations are that, and allowing for more transparency. I'm going to presume eye tracking is going to be hard if implemented at all but if it is, fade things out to semi transparent when not looking at it, like the map in particular.
Thanks for the advice! I am working on eye tracking and it will be one of the next major features. I think that will make me rework the entire design. For now, I did completely disable object recognition and I'll be reintegrating it more intelligently. The initial design was for proof of concept and this tech demo.
@@kerseyfabs Radical! I'm excited to see where this goes. This was such a cool video and makes me hopeful for actual AR, at least for cosplay. I can imagine, with some AC, this being genuinely useful at a con given some setup for booth locations or hotel maps etc. It's just sick af man!
One of the most impressive videos iv ever watched in years.
Much appreciated! Thank you Danny!
This is so cool! As a fellow SWE I would love to see more of the software side, all of it! Especially the gstreamer and Ui elements! Such an inspiration, thanks!
Good to hear from you Tim(othy)! I'm working on a complete open source release and I get closer all the time. Keep an eye out on this channel for more information.
Dude you may not be the first to make a HUD for an iron man helmet by holy hell did you knock it outta the park! Cant wait to see more!
Thank you! I really appreciate it!
Nice work , I like it !
idea that I would like to share as object detection is messy in real word / outside, you should :
1- Display only one object.
2- Display the object that appears in a specific spot / angle and track only one object at a time.
3- Display object detection animation in a static / specific / same spot of screen .
Looking forward to see how you will iterate the design and optimize portability (Energy/ batteries + Compute Power ) = heat management :) good luck !
I appreciate it! I'm going to replacing the current per frame object detection with proper object tracking. This was just the simplest to implement. Thanks for the ideas!
This is freaking sick dude. Please keep making awesome maker videos like this, holy cow Batman…
More to come! Thanks!
Incredible video, Kris! You're super knowledgeable and this was a treat to watch!
Thanks! I really appreciate it! Thank you for your awesome community!
I haven't much (any) idea of how it all works but that flashing (on, off, on, off, on) with object detection seems annoying. I wonder if a small delay before turning the hud element off to wait and see if it regains a high enough detection percentage would make the experience a lot nicer. I suppose it would be hard for it to tell if it is the same object but I think it'll be the better of the options...
Yeah, I already have several ideas to smooth the object tracking. I'll fix it in a future version. I could only do so much in version 1 and still get this released.
The best Iron Man helmet I've ever seen, by far
Thank you! Cheers! 🔥
Great job Kris this is awesome!!!
Thank you Oz! 😀
26:30 When you want the HUD like Iron Man, but you see the tall, daunting task of making it. Wow. You have more patience than me! I love tech, but I'm more of an artistic type of guy. I hope one day these components can be more compact.
27:15 You're local?! Wow!
29:30 I heard that record player scratch sound fx and thought, " Hey at least that kid saw "Endgame"."
Whelp, time to get back to work! Great video.
Thanks for watching!
Great work!!
Thank you!
Can you put the program in a link in the description?
I will be publishing the source but it's not ready yet.
This is the coolest project I have ever seen! Definitely gonna try make that HUD one day!
Thanks! I can't wait for others to start to recreate this! My source code is coming soon!
If anyone could make a functional Ironman helmet in real life, it would be this guy. 👏🏻👏🏻
Thank you!
Two years hard work!!?? Mad respect for your dedication and hard work! It looks awesome! Keep going!
Thank you! Will do!
This by far is the coolest helmet yet. Just add J.A.R.V.I.S. and voice control and Hacksmith Industries should be soooo jealous!!!!
Thank! I have both now! Video coming as soon as possible.
This is such a crazy cool project!
I can't wait to see the future of Iron Man suits.
Thanks! Keep watching!
You are iron man to many. Amazing work😮
Thank you so much 😀