Fully Autonomous Off Road Robot Navigating Using Computer Vision
HTML-код
- Опубликовано: 13 май 2017
- www.thingivers...
github.com/gua...
hackaday.io/pr...
The robot is using an 8 year-old laptop bought on ebay for $64.99.
(human-i-t Dell Latitude E5410 14" Core i5-520M 2.40GHz 4GB DDR3 250GB HDD WIN7COA No OS ... US $64.99)
No GPU acceleration, just an old but nice CPU.
The warning message you can see on the screen is the battery which was out of charge, and it died miserably a few minutes later. You get for what you paid for.
No LIDAR, no radar, no range finders, no depth camera, no sonar; just a standard webcam and in a pretty harsh environment.
Illumination changes due to the sun, clouds, trees, time of the day makes this problem incredibly difficult for computer vision. But it is flawlessly solved in here. Yet the big auto corporations can't get lane departure warning working.
I only use less than 400 frames for training. What if I had used more? I would have had a lot more precision for sure.
I already added a GPS and a compass but haven't had time to change the algorithm to use the heading info to guide the robot. I spent too much time trying to calibrate the stupid compass which still isn't working. That's why I had to change its direction a few times so it could follow the path I wanted it to go and not the other paths.
I didn't write the info on the screen but it's running at an astonishing 20fps. 
Хобби
"Don't mind me. Just walking the robot."
Really awesome and innovative.
Having limited resources and the will and ability to use your talent to figure it out at such a young age makes for great engineers the world needs.
Keep up the excellent work and continue progressing.
Awesome! I believe the Mars rover used a similar system. They used computer vision, path estimation, and path finding once a safe route was chosen.
Good job! On what OS did you run the laptop?
very nice ! publish more about this !
dude that's awesome
This is awesome
Cool.
Very impressive work.
I would build one if I can make changes and customize it for my setup.
I have SW2010 and yours must be newer. I can't read your solidwork files.
Is there any possibility you could save the parts as IGES or Parasolid from your SW version, and upload them to your github?
That way, other people with other CAD software packages than SolidWorks can use them.
You've done all the work, take it to the finish line. Cheers.
Hola Guadalupe. Muy bueno tu trabajo. Ahora estoy haciendo algo similar, pero utilizando un microcontrolador ESP32-Cam. Una pregunta: ¿Los cuadros de la primera y segunda fila que son más claros (que marcan parte del camino), los memorizas para confirmar la elección de giro (izquierda o derecha) que se hace luego con los cuadros de la 3era fila?. Saludos.
Nice work!
Are you using a pure computer vision approach (with I presume handcrafting of features) or are you also using deep learning for this problem?
I worked on two versions of the code for this robot, the first was a pure computer vision approach that used a series of functions to find the center of mass of the path and the second, this version, used a neural net. The code has been posted of GitHub here: github.com/guadabernal/Avalanche
Never seen a vision system like that. different & interesting 👍
Ayy I'm also from Sacramento
Awesome!
nice man
So damn gooooood
Hi, Guadalupe Bernal
that is great work.
Did you publish a paper for it?
If so, Can I have a look for a paper of your work? Thanks a lot !!!
I am looking forward to receiving your reply:)
Qué Belleza! xD ❤️🇲🇽👍🏿💯
I think it is a great project. Ca be configured for a lawn mower ?
Nice
Sir i need your help to make an autonomous robot using open cv for my project, which can work as a waiter during any prize ceremony. Please suggest me what to do ?
Arduino: 1.8.5 (Windows 7), Board: "Arduino/Genuino Uno"
D:\Final year Project\Hardware\New folder\SDC_Code\sketch_mar08a\sketch_mar08a.ino:1:19: fatal error: cstring: No such file or directory
#include
^
compilation terminated.
exit status 1
Error compiling for board Arduino/Genuino Uno.
This report would have more information with
"Show verbose output during compilation"
option enabled in File -> Preferences.
can you help me with this error ?/
cool ... What is you system componenets (hardware) And what type of algorithm did you use?
This version used a neural net to navigate. The BOM and algorithms were posted on GitHub here: github.com/guadabernal/Avalanche
❤️
Sogoii
With a confession that I am not competent to replicate your project even in one year, I wonder why you have to use a bulky (cheap though) payload. Overall, you have done excellent.
Because I have limited resources but I'm open to receive any donations if you're open to it ; )
I didn't want to bring my personal laptop just in case it fell haha
My point was, using laptop is an overkill. Regarding donation, I sometimes donate in kind (my tools, surplus kits) locally. I have subscribed your channel and will keep watching progress.
I'm running LeNet(the only topology simple enough to perform this classification) on each tile in the frame at 15fps on an iCore5 with no GPU. A Raspberry Pi doesn't have the power to compete with the iCore5 and a Jetson would cost 10x the price. Using the laptop was not my first choice but my only option.
Hello, any chance to have your email to further discuss potentially applications we have in mind? Thanks
@@GuadalupeBernal Hello Guadalupe, is your e-mail correct? It is not working. I sent you a message but came back...
Can your robot measure distance just from what it sees?
how did you do it?
Are you doing a master's in computer science?
Lir Dulce I'm about to start my senior year in high school lol
That's impressive
yah college is pretty much a waste. Its a great resource to network, but really there are enough meetup groups that you can network in real life easily. If you want a great class to get into technology look at cs50x on edx.
@@MichaelMantion Looking back through these videos, I decided to reply to this just in case someone ever reads this.
I am now a Junior at Cornell University studying Electrical Computer Engineering. I learnt more in my first semester of college than I did in 4 years of high school. That is not to say college is a necessity, but it is not a waste. Before college I was a hobbyist, and now I am a researcher contributing to the scientific community and doing work that will actually have an impact. I am planning on getting a PhD once I graduate and hopefully then continue this channel with even more interesting projects.
@@GuadalupeBernalWonderful, I just happened to pass by this video as I am stuck with my project also using CV however I'll keep trying and hopefully finish it as this is my last year at the University of the Witwatersrand. All the best with your work!
Hello when I can find the hardware list for make this Project?
hackaday.io/project/20636-avalanche
www.thingiverse.com/thing:2194445
github.com/guadabernal/Avalanche
There isn't a complete parts list anywhere as this is a very developed and complicated project, but all the code and 3D printed pieces can be found in those links above.
Does this use OpenCV?
I worked on two versions of the code for this robot, the first was a pure computer vision approach that used a series of functions to find the center of mass of the path and the second, this version, used a neural net. The code has been posted of GitHub here: github.com/guadabernal/Avalanche
I send mail for you..please check your inbox
Thank you..
Truely awesome video, great job, had to dislike because you added music. Can you upload with out music please
So you disliked a robotics artificial intelligence video showing you something that has not been done before, that’s better than Tesla’s cars that can barely drive within a clearly marked lane, because of music? Lol turn your volume down if you don’t like it cause that song is damn awesome.
@@GuadalupeBernal I dis like the video. Sorry I have to be honest the moment I clicked on the video and heard the music It completely altered my emotion. I went from positive to negative in a second. First it sucks, no one would listen to that music on its own, so why would you add it? second its LOUD, why do i need to crank down the volume or mute your crappy music choice. See the problem is your video isn't a music video, I didn't click on the video for music. The subset of people who like AI and your current crappy taste in music is small. I took the time to tell you because the video is really amazing and I impressed with the work and think people should watch the video. But ultimately I have to choose if I could go back in time and watch your video. The answer is 100% no. There are so many awesome AI videos on the net, The more consistently I rate videos the better youtubes Algo will send me videos I want to watch. I am certain the sounds or music I like are not the sounds or music you like. Again your not a music video, so you should have no music. I understand there are people that like to add intros to their videos or think they can use background music to alter emotion, ultimately that is simply not the case. Lots of people listen to their own music in the back ground. If someone really needs music they can find it. silent video is perfectly fine, but the actual audio from the rover would have been awesome. You can of course voice over explaining your self, goals, techniques you use. Please understand I watch over 100 videos a day some days over 1000 videos. I don't coment on most videos so you are welcome, consider yourself special. Also in general ALWAYS thank people for comment. Especially if you disagree with them. If you only got and liked comments you agreed with then what would be the point in reading them? Thank you for replying to my video and when you re upload the video with out music reply back to this with the link and I will like it and share it and sub. L8r
Booyah
@@MichaelMantion such an emotional piece of s#|t. Calm down this is not your aunt's dwelling.