Computer vision using GoPro and Raspberry Pi
HTML-код
- Опубликовано: 11 сен 2024
- In this video I demonstrate how to do some computer vision techniques on the Raspberry Pi 3 using the video feed from a GoPro Hero 3. I'm using a HDMI to CSI bridge (B101) to read the video from the GoPro. More info at: altax.net/blog...
Наука
Oh man! thank you!! I just bought 2 different raspberry pi´s and this is my first time buying them.. I have some basic experience with unix and linux even at entry programming of witch I remember nothing, but it will be interesting to go back and build something usefull!!! Back then in the old good times we used linux and unix strictly for building servers, but that changed!! Oh WOW!! this is soo cool.
Hi, where do you get to buy that module? Looks like the Auvidea's web site is not active
They change the domain... the new website can be accessed here: auvidea.com/b101-hdmi-to-csi-2-bridge-15-pin-fpc/
Thanks, I asked a quote and hope to get one asap.
Hello Aldo. I have raspberry Pi 4 and a go pro hero 10. Is It possible to interface it through the usb port?
Hello! I have a similar project but tracks very small objects. Stumbled on your video to find solutions. Would it survive if I plan to use this 12-24 hrs? Thank you so much!
I do not see a problem running your gopro 12-24 hours, as long as its powered it will be alright! good luck in your tests!
@@AldoVargasMoreno thank you!!!!!
Hey Aldo,
please remove the pi from the foil packaging! It may be antistatic, but its conductive!! You may damage the pi by putting it on there!
thanks for pointing it out!! cannot remove it from the video hehehe, but from the device is gone! cheers!
Hello !
I try to do this with a GoPro 7 connected to an acquisition card (HDMI to USB), do you know what I’m supposed to write in the command to get the live flow ?
I tried your script but it doesn’t works in my case ...
Thanks for your help !
what acquisition card are you using? the b101 like mine?
Hi Aldo. This project very interesting. I want to ask you a few question. Frst is do you use the hdmi to micro hdmi cable? Second is. It is possible if i use dual system gopro to connect to raspberry pi?
Hey, I connected a cheap china GoPro to my raspberry pi 3B having 1GB Ram so that I can work with OpenCV but the input feed has a dropped frame rate. Like around 1fps. It's very laggy.
But in your video, there is no such lag at all. I had connected it using the USB port. Is there any way that I can improve the frame rate by any chance.
try open that camera in a normal computer using vlc and see if the performance is different... then try again in the rpi but using vlc and see if it behaves better... my guess is the compression of the video...
I am really interested in your project. I would like to have access to your complete list of materials (if that is possible)
I see you used Raspberry pi 3, a GoPro, HDMI to CSI-2 Bridge, a mouse a keyboard, a computer and their own cables... but I feel I must be missing some other or pieces.
Could you please help me out?
Thank you very much.
hi! what you mention is what you need for doing the basic stuff I show in my video... what do yo want to achieve?
Great work!!!
can I use this HDMI to CSI bridge (B101) with arduino?
I do not think so... it was designed for the rpi, but you can contact the manufactures directly!
Fantastic!
hi. how could the "rpi-opencv" appear on the terminal console? cause it's not appear on my computer :)
hi, you can read my blog post and check how to do it... the "rpi-opencv" is my repository, so it means you have to clone it and then access to it, thats why it appears in my console. altax.net/blog/computer-vision-using-gopro-raspberry-pi/
can you use older hero2 gopros and use them as security cams? i have severeal of them that is why I ask
yes for sure, you can use gopro hero 2 and also you can use them as security cameras, you will need to have them plugged in to usb power tho... cheers!
Cool video Aldo!
Aldo. Buen trabajo. Tengo una 3d printer y con oxtoprint quiero hacer timelapse pero no me reconoce la hero3 vía USB. Crees que esto solucionaria el problema? Tendría que instalar algo en el micro SD card?
hola quieres hacer un timelapse usando un raspberry pi y una gopro? para poder leer la gopro con el rpi, necesitas el b101, que es un dispositivo que lee hdmi y lo convierte a CSI camera que es la q lee el rpi... si no tienes ese dispositivo, puedes usar una camara de rpi con un lente wide angle, hay muchas opciones! :D
Hey Aldo, I am also very interested in using computer vision on multicopters. Had you done any work on stereo-vision using raspberry pi?
I am working on project in which I have to do stereo-vision and I had to use two raspberry-pi one for each picamera but I am facing bottleneck in tranferring image from one pi to another. I am thinking about buying two usb cameras but I am not sure if it would be fast enough. I will appreciate your thoughts on this matter.
oh nice!! there is devices that already have two sets of cameras, check out the intel realsense r200, if you want more info, send an email via altax.net cheers!
There was also something from raspberry pi foundation called "compute module" but I don't think they have these anymore, that would be a good solution for me. I just sent you an email just to start conversation and will ask more question over there ,if I have any.
Hi Aldo Vargas. I have bought B101 but unable to get video from GoPro. Do i need to install driver for TC358743 or something else?
there is several versions of the 101, which one you have?? v3 does not requiere any change...
B101 rev 4 and RPI 3 Model B V1.2. And i tried every HDMI sources but nothing happen.
check their manual in order to activate it properly: auvidea.com/download/manual/B10x_technical_reference_1.4.pdf
Aldo excelente aporte pero en mi país Ecuador es un poco difícil encontrar la tarjeta HDMI que permite que raspberry pueda leer la GOPRO. Sería grandioso si nos brindarias alguna alternativa para realizar está conexión y si no hay ningún problema de conexión con la nueva GOPRO HERO 4. Gracias
this is better project ruclips.net/video/vGCEwSspKgA/видео.html
Isn't it possible connecting the GoPro directly into HDMI or USB of the Pi?
nope, not possible. The hdmi of the RPI is output only and the USB is only for transferring files to/from gopro
Do you know if it's possible to stream like this from a GoPro to a PC? Is it mandatory to have a capture card? I want to process some high fps high resolution pics live so I need a powerful PC, not a Pi.
the gopro can stream to a pc, but it will not be a fast stream, if you want to process video live or with a very small delay, you need a cable or maybe the rpi (with capture card) sending a stream to the computer and making the CV processing on the computer, I have done the latter and it works great.
Aldo Vargas what kind of cable and card did you use?
I specify it on the description of the video and on my blog post, if you want more specialised help, send me an email via altax.net cheers!
Great video! Can you control the GoPro? Turn on/off without manually hitting the on/off button on the GoPro.
Yes, via Open GoPro
did you overclock before or after and test results? how it go ?
no overclock... everything on the RPI as default.
Hola...genial el vídeo...que tipo de datos se obtienen del tracking y en que formato? Muchas gracias
gracias, los q se ven en este video es position x y y del objecto y tamano del mismo (area)... y el texto sale en terminal, saludos!
Have you thought about using an odroid instead of a raspberry pi? They have more power.
yes, I use them a lot, the u3 and the xu4, also the up-boards using the intel atom are very very handy being x86 they are very compatible... cheers!
i've been doing this with a kodak pixpro sp360 4k but i'm unable to get any footage with the b101
have you tried another camera? if not, please try... this module only reads up to 1080p, maybe there is an issue at inputting 4k video...
Aldo Vargas yeah i tried setting up the camera to the lowest resolution which is 1072 or something, yes, my brother tried with a gopro and a sony, and both worked like a charm, but don't worry, i tried yesterday and i only got a super glitchy image footage from it, i dropped that plan and set the camera to webcam and connected with usb, using an app named motion
@@NicolasSilvaVasault B101 as i know just supports 1080p 25, on 1080p 30 you are getting glitched out pictures. hardware wise i think it supports up to 1080p 60 but software isnt there yet.
@@0000000000323120 i tried it with a gopro, 4k 30fps, and it did worked with that one, not sure why didn't picked the kodak, quite sure is related to drivers
4k is too much, this device can only handle 1080, try lowering the resolution output of your camera and test again... cheers!
Hola Aldo, muy buen video, tengo un proyecto interesante que me gustaría compartir, sería posible hacerlo con múltiple cámaras, para transmitir en vivo utilizando el OBS studio. Sé de la existencia de algunos dispositivos que hacen eso como el BlackMagic design y otros software de android o apple que transmiten simultaneamente varias camaras ya sea de los celulares o HDMI por streaming pero la verdad son muy costosos, quizás se pueda sacar algo más accesible al público ya que ahora la tendencia es por hacer streaming en varios medios.
Era pregunta jejeje me olvide de colocar esto "?"
Would this work with a dslr camera or only with a gopro?
with any camera with HDMI output... I have tried a gopro and a sony nex5r.
Thanks
MUSIQUE INDIENNE
MUSIQUE INDIENNE ET ALGÉRIENNE
Merci
Hey. Do have the wiring diagram of that? :)
you can check my blog post: altax.net/blog/computer-vision-using-gopro-raspberry-pi/ if not, send me an email to aldo@altax.net
@@AldoVargasMoreno where is the usb port on raspberry connect to? :)
Aldo Vargas this is very interesting. We should definitely talk. I need some help on a current project.
for sure, send me an email via altax.net! cheers!
I is compatible with gopro6
yes, it should work!
Shouldn't have the board on the anti-static sleeve while it's on!
so where to put it then?
you do not need a wifi dongle plugged into the ras pi as it has onboard wifi
My router only allows certain mac addresses to get access, therefore is easier to plug that wifi in that adding the mac address to the router table...
you can get the mac address of the on board wifi dongle
of course... very easy. You know how many rpi3 do I have?? 17... its easier to just put the dongle.
i get you, i only have 1 pi 3 and my router allows pretty much anything what is not blacklisted, and also may i askm where do you get the hdmi to raspberry pi camera thing, please make sure it is available in the uk
one makes more sense! :P, I'm glad you understand me... I'm based in Scotland, I bought the device via their website and payed via paypal, it was a painless process. It is a very nice device. cheers!
Hola Aldo, excelente trabajo me entra la duda de si es posible trabajar tu proyecto con otra cámara que tenga salida hdmi? Tambien me gustaría tu asesoría respecto a si este modulo se puede usar como el puente B101 que utilizas en tu proyecto.
articulo.mercadolibre.com.co/MCO-464077773-modulo-de-extension-de-cable-arducam-csi-a-hdmi-con-15-pi-_JM
no se exactamente si se pueda usar en reemplazo del b101, pero pues lo podrias comprar y probar...