How easy is it to visual track an object? PSVR Headset Tracker with the OpenMV-H7 Camera!
HTML-код
- Опубликовано: 6 июл 2024
- Get your 75% off Gold Elektor subscription here: www.elektormagazine.com/news/...
Coupon Code: greatscott20yt
Previous video: • Top 3 GreatScott! vide...
LIDAR video (previous Elektor video): • Is LIDAR easy to use f...
Facebook: / greatscottlab
Twitter: / greatscottlab
Support me for more videos: www.patreon.com/GreatScott?ty=h
Websites which were shown during the video:
www.elektor.com/
www.elektor.com/openmv-h7-camera
openmv.io/
docs.openmv.io/openmvcam/tutor...
www.trinamic.com/fileadmin/as...
www.thingiverse.com/
In this video we will have a closer look at the OpenMV-H7 Camera. That means we will learn a bit about Python programming before I will show you how to use the camera in order to track a face, eyes, objects or colours. At the end I will then combine the camera with 3D Printing and a stepper motor in order to create a system that tracks my PSVR headset. Let's get started!
Thanks to Elektor for sponsoring this video!
Visit www.elektormagazine.com/ to read their magazines and buy electronic components.
Music:
2011 Lookalike by Bartlebeats 
Наука
VR developer here. Moving the camera defeats the purpose, and ruins your gaming experience as your relative position is what determines your position in the gameworld
Well, that is what I thought as well at the end.......
Maybe you could send some kind of "displacement" value to the headset every time the camera moves? I don't think this is possible with the PSVR though
Hook up 2 wires to activate re-centering after a large number of steps in the motor has occurred? Is there a button to solder into, or perhaps a bit of signal to emulate from the headset?
@@mwm2929 exactly what i was thinking
@@vke6077 on pc that would probably be possible. On psvr though i don't think it would be that easy.
I just became obsessed with VR videos literally yesterday, now this video is uploaded. I'm so happy right now!
I love this new sofa video style
Hello sir....I am from India .....I just want to learn from u...all the basic and advanced concepts.....thanks....all of your videos are very important for me ....
@GreatScott, you really don't want to move the PSVR camera using a motor while playing!
That will completely screw up the tracking of your space in any game you are playing (on top of the PSVR tracking being quite poor already, compared to e.g. Rift, Quest or Vive). The camera position/orientation is what mathematically determines where there is the origin ("zero") of your (= game's) coordinate space. If you start moving that around, you are screwed - your space will move with it. Not good - if anything it will make you dizzy because the scene will be constantly moving even when you aren''t and throw off your proprioception ("I thought my hand was here but it is there?!"). I believe PSVR doesn't use anything like the Guardian or Chaperone systems of Rift/Vive that show you when you are about to exit the boundaries of your play space but if it did, those would be constantly moving with the movement of the camera too, rendering them useless.
The only way to make that work properly would be to have a positional feedback on the motor (e.g. an encoder or a stepper like you have used) and feed that into the algorithm, so that it can compensate. Doable if you DIY it but obviously not applicable for stock PSVR with no source code access.
A better solution is what has been used for the original Kinect, which also had field of view issues - a set of supplementary clip-on wide angle lenses that let the camera "see" larger space.
(and yep, I am a VR engineer/developer/researcher too)
skill level 11 play drunk!
PSVR tracking is solid when setup up properly.
@@NETBotic Fine, but not compared to other headsets.
Yeah, I was thinking that since he mentioned he wanted it for VR: won’t it mess with the tracking algorithm? And I’m a VR noob!
Darth Vader says NOOOOOOOO!!!!
Friend walks in room wearing blue t-shirt, psvr "extreme difficulty activated."
You’ve really taken things to the next level recently with your new introductions and production quality - great work. Thanks for all your great content, you’ve inspired me to start my own channel 👌🏼🙌🏼👏🏼
nice that you keep changing the videos up a bit! I liked the intro a lot
Great video tutorial man. I somehow need visual tracking for one of my projects. Nice!
great scott seems very happy today(those bottles in background might be the reason) :-D
I love the new style of video when you film yourself for the Intro ... It's great !
Really liking these new in person intros. Cool stuff
Morgen GS, alles Gute im 2020 und vielen Dank für die hochwertigen Videos.
Hi from Nicaragua Im an Electronics student
I enjoy and learn a lot from your videos and proyects continue, with that we'll learn from you thanks..
I really like this intro!
Thanks :-)
X99 did someone asked
X99 and how the fuck u commented 1 week ago
This video was uploaded today wtf
@@Idk-qg7hb Patreon early access?
Never thought I'd see all these elements in one Video!
surely the movement would just make the psvr think you are moving in the opposite direction? does the ps camera know that it is being rotated?
no, it does not. That is something that could be added in easily enough (it's just another transform operation), but as this is the only movable camera setup in use....
Loved this video! More integration projects please!
Thanks :-) I will give it my best.
The videography was different than your usual videos
I like that😀
Fantastic project, dude! Really well done! 😃
really cool project. keep up the great work brother.
New year, new intro, and I love it (the new intro) ;-)
This project is really fun to know, Thanks!
9:52 just glue a different color led on the headset and track that color😎
Haha also possible :-)
"Five minutes crafts"
I was thinking he was gonna glue googly eyes on the PSVR headset to use the face tracking
Or track an object. If the object is the goggles then it should be fine (or even better).
@@thisfeatureisbad 😂😂
You are a Real Genius ! Your Projects are really cool ! Thank you !
Facecam projects are awesome ❤
Intro was sooooo satisfying :)
Nice job man! I’d be stoked to have built something like that. 👍
Great, as always !
Keep it up bro !!
Production quality of your videos are impressive
How to use electronics to greatly increase the chance of motion sickness in VR
Hey Scott, Thanks for teaching electronics to me i finally made my first project without any tutorial needed
you rock ! : )
Awesome 👍
@GreatScott! you never fail to amaze me man .... keep up the good work u are awesome
I like your AMAZING SUPER videos! Keep it up!
You are the best of électronique
Thanks for the video! It was really interesting and entertaining.
Durchaus
Great video.
Now I want to make a stand for a camera to track movement in my garden with one zoomed cam and one area cam.
Excellent! Gonna build some precision guided munitions now...
Sehr professionell auf den Schrittmotor zu schlagen.
Dlib can create a 3d model of the blue areas and extract pitch, yaw, and roll along with location using object recognition. And it's friendly C++. Great library.
New intro. I love it😍
@GreatScott Awesome vid. If it’s picking up multiple objects then track the average of them. E.g. For 2 objects... x = (x1+x2) / 2 and y = (y1+y2) /2. This will set it to track exactly in the middle between them
Great video and a good proof of concept! One quick suggestion, drilling holes into 3d prints to mount things is not recommended because the only surface the screw is biting into is the infill (which is generally a very small amount of contact area). Although, in this case, it's okay because you didn't have to deal with large loads.
Unless you print with 100% infill.
@@321ooo123 true, but it's unlikely under most circumstances, I go up to 40% infill max on my prints
I love this intro sincerely I watch your videos last 2 years but I never see you in any videos this is awesome 😊😊
You're welcome :-)
It's my pleasure and I'm learning electronics and I love electronics
@GreatScott i do love everything about your work and this channel.
Btw, In load consumer electronic master on/off switch are made using push button switch, to trigger action from microcontroller.
If by any chance this topic might interest you for an upcoming video, i'd be glad to see in which condition such device is required, pros and cons using them, and how to turn on/off an Arduino based project to put it in deepsleep mode and wake itself up..
Thanks for such amazing content, keep on doing what you do, it's really helpful..
The Pixy2 with servo module would be perfect for this application.
That project would have been at least 6 months of hard work, at the time I became an electrical engineer. Nice work.
When you finish your elecric Simson ?
The idea is great 👍👍👍
Would love to see what else this camera can do in the future. Review possible?
Awesome project. This gave me an idea. I have that camera, and an STM32F446. I have to check if the openMV IDE likes it. microPython is portable.
Awsome video! Although it is not usable with vr for obvious reasons I really like video itself.
One of your best video IMO. Gave me a lot of ideas for other applications. I am assuming just the sample code was in python but could be programmed in C.
Did u try out esp32 ai thinker with camera. If u do, would u do a video on image recognition on Arduino ide
Thank you a lot for this video
Merci Scott pour cette réduction sur l'abonnement Elektor!
Enjoy Elektor! We're sure you'll love the magazine and all the benefits of a membership!
Would you mind sharing the code that you ended up using? Thanks!
Hey can u explain how to use x box camera in making picture of 3d printer
Thanks for the info!
Your video is amazing. I would like to use a system like this to find any objects in the sky, like planes or satellites.
Your videos are awesome, and it's way better when you appear in the video 😊
Wow! Thanks a lot sir!
Some parts of your LiPoChargeProtectBoost-circuit are discontinued on LCSC.
Could you build a updated version of this project please? ^^
Another awesome video! I cringed around 8:23 though. Get a small arbor press for such tasks.
Can you make a motorized pan/tilt head for a camera?
Can we use open mv h7 camera to detect oncoming vehicles and control hi lo feature of headlight in automobiles, kindly advise.
Awesome intro
Three of my favorite words: Let's get started.
Solving a similar problem, I used a lens to widen the view of the camera. I have also built software to identify and track position of pixel color on the screen and simulate mouse clicks while running games to keep logged in while I needed to be afk. I really like this build you have for face and eye tracking ability. It has lots of potential for security purposes. Perhaps locate a face and zoom in for a few HD screen shots, thus solving the problem of almost all security camera footage of criminal activity where they can't identify the criminal.
Hey bro! your videos are so awesome, if you have time, kindly make an experiment about "sonoluminescence".
Can you make terminator vision like t800 use openMV -H7...
Lmao that intro was hilarious 10/10 video just because of that
Did you make 12 volt power supply to run hi amp dc motter
it's cool... you make camera paning...!!!
Keep up the awesome work! I might get Tetris effect. Can you believe Joseph is 16, and Greentea is 20? That's crazy. I hope Jonas makes it back next year, but with the hyper tapping, I fear he may not. Maybe we will see you in Portland next year???
Finally a module to put my python knowledge into
I did exactly this 8 years ago for a painball sentry gun and an rdd2 head. Spent months creating algorythms to work out objects ranges and trajectories..
Very good 👍
thanks for phython also thank you great scott for share thes awsome progect :)
What source you used for python and how much time it required
Can you make a video about how you organize all your stuff bolts, parts, nuts and other tools
You don't really want to move the camera while playing. However, you could trigger it when you sit down, but before you start playing to ensure you're in the middle of the frame no matter where on the sofa you sit, or if you go from sitting to standing etc. Plenty of possible ways to trigger it with the camera, or a GPIO etc.
can you do one on night vision goggles I've trying to figure out how i could make some
hello scott
can u make a diy short killer video ?
Very Nice. Ya I Enjoyed
I think moving the PSVR camera will cause the "zero" point in game move with you, kinda like the whole room would shift to left or right. How about wider angle lens for PSVR?
Can tester work in DC?
Hello GreatScott! You should look into Oculus Constellation tracking.
It's an obsolete tracking solution right now, but this is how the Oculus Rift CV1 was tracked. It's also visual tracking, but by using multiple IR camera sensors. You can use up to four of them, but three is enough for a full 360 degree roomscale experience up to 3.5m*3.5m. PSVR having only one camera sensor makes it incapable of more than 90 degree tracking and roomscale experiences.
In any VR solution where external sensors are used, it's key that they remain stationary as they form the anchor points from where the headset and controllers are tracked in space. If you move the sensors, you move the entire playspace and tracking will mess up.
Oculus replaced Constellation tracking with the release of the Rift S and the Oculus Quest in favor of their "Insight Tracking" system, where the IR camera sensors are placed on the VR headset itself, removing the need for external sensors.
Really gud man😊
Hi, could you make a Video about how to use the 74hc595n with Arduino Uno!?
Żubrówka in the background
Gdzie?
I would love to see something like this used for camera tracking to keep things in frame for use guys that do not have people to film while doing repairs ect. like a overhead camera rig that would track a colour in frame and I can have a it on my hands or on what ever I am filming.
@GreatScott Hi I am trying to repair my Bluetooth speaker, but I am not getting out any audio from the speaker even though it is attached to the board. I have a pair of wires that come form the sub woofer
You should build a pan/tilt version
Attach an infared LED or UV LED to the headset, and put a filter in front of the camera. This is actually the same technology some head trackers use, and it is effective. Constantly moving camera might still be bad though.
The coolest Motion Tracking Project on Earth is "Automatic Bullseye, MOVING DARTBORD" from Marc Robber at RUclips.
Marc Robber - Freudian slip there for Mark Rober?
@@Drew-Dastardly Seems I am just to stupid to copy some simple letters, sorry. 😃
@Marko ...and it tracks objects in motion....
@Marko so motion tracking has to track an object in the whole universe?
This is completely off topic but how did you get so good in electronics? Also got any book recommendations ? I want to self learn this but I always find myself lost . Anyways thanks for reading this.
Can you test jlcpcb smt service please.
I saw you finally 😍😍
Brother I need help.i want 3.7v to 5v DC booster module.i want to boost voltage of 18650 battery to 5v DC.
Which ic that you recommend?
I hope you understand.
Stability can be added by adding a saturation curve (dead zone/schmitt trigger) for the center/reference point.