OpenCV Python Neural Network Autonomous RC Car
HTML-код
- Опубликовано: 27 сен 2024
- May 2015
Self driving RC car:
OpenCV neural network - Steering
Haar-cascade classifiers - Stop sign and traffic light detection
Ultrasonic sensor - Front collision avoidance
Raspberry Pi - Data streaming (video and sensor)
Arduino - RC car control
BGM:
[Hunter x Hunter 2011] Original Soundtrack 3
28 - Holding A Card File üm-ün
Apologize for the ad, at this moment, the bgm cannot be changed or removed.
Source Code:
github.com/ham...
zhengludwig.wo...
Imagine how cool it'd be to have a whole bunch of them driving randomly on a little paper roadmap following laws and such.
I support this idea 1000%
It was only responding to static objects. So I think there is long way to go.
Unless they have already done it.
@@JeevayPakistan Tesla and other companies already does this well, but there is need to many improvements indeed.
"obeys the law" ... "is autonomous"...
you fucking millenials dont know wtf yr talking about
@@Ghryst In this case, autonomous only means free from any manual driver control, not free from anything and everything. It could still be following traffic laws and be autonomous.
Fake. There is a small person inside the car
lol i'm dying
😂😂
Oh! Are you in that car?
🤣😆😂🤣😆😂🤣😆😂
😁😁😁
never wear a green outfit infront of this car
Tanvir Chowdhury lolololololoooloo
but it recognizes rectangular traffic light shape and recognizes green light later. Not all green things. It should be under that shape
@@science_mbg what is with programmers and jokes flying 3,000 miles above there heads
@@ThatGuyDownInThe coundt get it that he might be sarcastic my bad
@@science_mbg now I feel mean :/
Great Job!
Im your follower and like you
This game is amazing .
Check it out
ruclips.net/video/MLcu3sBKhdE/видео.html.
@@cybercodes369 Why should I trust a Microsoft Spy?
@@benitokim1793 ok then keep sucking 😎
Perhaps the only self driving Range Rover out there ;-)
I am studying Embedded System Development and I would find it awesome to go working for Land Rover. So maybe in the future there will be ;)
Lucid Gaming No please don't work for that awful car company. I'd rather work for a company which makes reliable cars.
TheGrayWolf81 Whats the problem you had with the brand?
They're just unreliable cars. My friend got a brand new one not too long ago and it's already having problems. Any other person I've known who has one has had problems with it (although some older models are nice and don't really have problems). I've never had much luck with English/British cars :/ But there are probably other people who love them and haven't had any problems yet. If I were to buy or do anything with a car, it'd be a Toyota or any other Japanese engineered car. They're the most damn reliable car I've ever owned and seen.
Why do you have a verification badge
imagine making few of these cars and making mini city, then upscale this
It takes more time
Wow first I was getting old videos in recommendation and now I am getting the same video that I watched years back giving me LOL and nostalgic feeling altogether.
please make an instructable
Shiva Kumar Read his paper.
Where can we read the paper
@@harshitsomani1717 It's the last link in the video description.
congrats for this project dude. it's really brilliant and thx for sharing your work. u rock !!!
I absolutely love the fact it's a red Range Rover. The most awesome vehicle out there and quite possibly its best color.
1:43 the fact that it knows that there is space in between the obstacle and itself is pretty great, I though it had to wait until the obstacle was out of the frame.
It's using Ultrasonic sensor to measure distance between obstacle and the car itself
Me: still
Print("hello world)
Output: Error EOF while scanning
Computer shutdown
Edit : oh need to edit this ... Guys I am trying to make a dumb joke and u guys are replying that" this is correct this is wrong"....... I know
print() can’t be capitalized. And I did get the joke.
I know guys what the error I am just kidding.
I am also a python programmer,
And about 'p' it's is becoz yt comments
Wait I got it........... you are passing a double float. Please convert to cell array and import fun functions. Can you believe I failed my programming course work?
def Print(text):
print(text)
i am computer vision engineer myself but this work that too 5 years past,,, this work of your astounds me
Damn! you are good, Google should hire you to collaborate on their Autonomous car project.
What's next? Autonomous drifting Nissan r34?
YurkerYT Haha, good observation! Maybe 86 as it's easier to drift... ?
Yea they would hire if he did it 30 years ago
Wang Zheng would you please share some tutorials. I am Python developer and I am interested in this field. please share some useful tutorials..
Bro once you learn raspberry pi learn opencv machine learning and neural networks you will able to create this and more than this don't learn to make only a make your base strong you will able to make thousands of projects
Except that good dont meddle in such basic things, and instead research more professional and complicated works
Looks great! Next step would be to get rid of the IR proximity sensor and detect obstacles via the camera alone.
Nice work Wang it's good to see that you are sharing your knowledge with world.
centaurirobotics.in/learn/
Yt:lets reccomend this 5yrs later
Now you can recreate that GTA SA mission with the RC helicopter carrying barrels.
That was in vice city 😂
@Hot Dog Oh, one in VC was to carry bombs.
Yes it stops at red and goes at green. The big question though is if it speeds up at yellow! On a serious notes, great job!
"Mom, can we have tesla at home"
"We already have tesla at home"
Tesla at home:
Should Hire this man for future cars
I like how this is build up. Using every single item you find in the household, ordenary cardboard, tape, womans hair bands... This is exactly how I would build it :D
I am buying ruspberry.
Looks really cool.
Like.
This shows how good are autonomous cars
No, no, no. An R34GT-R will never be an obstacle in front !
True
So he used a Hunter x Hunter Theme to describe the epicness. Smart!
This is awesome! Please make a detailed video series on this project.
Actually this project is quite simple. It has been just elegantly displayed.
Okay then explain the control system architecture, how the CV and image processing works. Could be easy but I'd like to hear!
These on a model train layout would be nuts
Can you make step-by-step video tutorial for this? This is just amazing.
yes plz send step bystep this projcet
Sure , you just have to pay the price , you beggar!
ruclips.net/video/GnnFy0uFe3E/видео.html
@@pperez1224 🙄🙌🤬
It stops in 2015 better at that stop sign than a Tesla in 2021.
:o I remember I saw this many years ago, and it was my inspiration to do an AI course and learn a lot. I never got to do this though, hope I can soon!
There is a MIT OCW course on AI. Course Number 6.034
It is FREE.
🙂
came for the opencv, stayed for the tunes.
Plot twist : A guy was controlling the car using remote
Great.❤️ WHY IT IS RECOMMENDED 5 YEARS LATER ALSO.🔥 🔥
Whoah! That is impressive! In fact, incredible!
So who made this is a "man of culture as well".
P.s. The song in background is "Holding a Card File" from Hunter X Hunter Original Soundtrack.
Yeah, it's in the description!
Only one thing left to do, make it smaller, try to fit the gear under the body of the car, I would say its hard but looking at what you have done here I think you're up to the challenge.
Pretty cool, I was thinking about doing something like this back in 2015 and did some testing to see the feasibility of building autonomous racing robots with raspberry pi. The performance of python with openCV was too slow to process 30 frames per second based on simple benchmarks. I thought about off loading the image processing to a workstation, but decided to wait until raspberry pi got a faster processor. With raspberry pi 3 B+, I think it has just enough power to do it all on board without offloading the processing to a desktop or workstation.
dayum computer science rules, I a mech eng student and seeing these just made me feel that I'm ignorant. btw I am truly interested in machine learning ai and robotics, hope to work with u in the future if we ever get the chance.
Really amazing!! If it comes in real life it will better for our country .
Why did i Just start loving OpenCV and going to learn more about it?
imagine elon musk copy his code for tesla car
Elon Musk has some slightly better hardware and software than a crappy Raspberry Pi and open source computer vision software.
Beautiful music for the subject. Seriously
Good work! Way too good to see some of the common sensors act too smart!
Maybe now he is working for Land Rover to build autonomous cars
It could be one of those little black box droids from Stars Wars for Halloween.
That R34 though
Good lesson for those who are trying to pass their first driving test.
This absolutely revolutionary
Looks like it only stops for obstacles, because of the ultrasound distance sensor at the front not opencv.
When people showcase their project online: Works perfectly, flawless, shows that the field is interesting.
When I try to replicate their project without source code: What do you mean this is not a lane? This is a lane! Why does a machine with hundreds of math formulas fail to identify a lane, while an idiot with elementary math knowledge can detect one?
whatever you do we always gonna tailgate until the licence plate finds its pair to make out.
That’s how Tesla begin with the cars 🚙
a good Autonomous car project. keep up the work!
Very impressive! 🤔
Great job! Excellent! One moment...
In real life if there is no stop line, you should stop near traffic light, in one line. But it's a small issue)) Good luck!
I read the description of your project on your wordpress and have a question if you don't mind: For your training dataset of input image and output direction input, did you hand label each of the images to have a certain output? For example, if the track is a slight left turn, did you take, assuming 10 fps, 30/40/50 images and hand label each to make a turn when you feel it is appropriate to make a turn? Thanks and great work!
I am curious to know about this too.. Is the training data hand labelled or you trained it by controlling the car via RC..
I just found out via his github and it confirmed my suspicions. He trains manually, saving a training image whenever he makes a keypress.
Nontheless still an impressive piece of engineering. Whatever you do in life there's room for improvement, he can improve the training.
the algorithm explanation will be much better than music
I'm curious to know why you chose mono vision instead of stereo vision?
He probably wanted to use that Raspberry Pi which only supports one camera at a time. Therefore, he used the ultrasonic sensor to detect depth instead.
Aterrebgnuoy you can use 2 camera using USB
Distance Measurement
Raspberry Pi can only support one pi camera module. Using two USB web
cameras will bring extra weight to the RC car and also seems
unpractical. Therefore, monocular vision method is chosen.
zhengludwig.wordpress.com/projects/self-driving-rc-car/
There was no need for stereo vision. Stereo vision of for depth sensing and wider FOV. The ultrasonic sensor does the depth sensing while the FOV is good enough. So no need for stereo vision.
FOV- Field of view
Nice work. I've made a vision based distance estimation using stereo camera. I really want to learn opencv and python when I do my research, but I learn slowly. It's look very cool. Hopefully I can learn the theory
Same
If you want to detect distance based on camera you need to use two camera to perform sensor fusion, just a single camera is not enough to measure a distance.
Wang Zheng
bro can you share the paper ?
the link you have given is not working
i loved this hxh theme playing
great , it needs speed limit.
Very nice project. Congratulations!
Congratulations for your awesome job ;)
I found this project interesting. However, it seems that there is no motor control from the Arduino or Rasperry Pi. I guess you are transferring the wireless signal back and using the remote the control the car...
there is motor control for RPi ;)
NO You are not right
So why there is ultrasonic sensor in front of the car ?
I mean, it's most likely going to be awesome if it has HxH ost in it.
As Beautiful as it should be
what about keep left or right ? Like Australia is left drive, scan to left edge of road. ………. American is right drive.
This isn't funny.
Great work!! Appreciating your efforts..
Hey Harikrishna, now you can make your own autonomous mobile robot. Check this out:
centaurirobotics.in/learn/
PLZ SAHRE WITH US YOUR PROGRAMMING AND FROM A to Z, HOW TO MADE THAT CAR
I was about to skip to the middle but then I was like - wait, I know this song
Can i use a normal webcam instead the raspberry one?
yes, but you should change the code in Streaming
have you tried the code??
Amazing Interesting & Impressive. These types of video encourage me to code in python. Thanks! Keep share this types of ideas. Love. P.
Encourage me to also code in python
+Wang Zheng Thank you Wang, Would you tell me you training code that you used to train you haar classifier? I am working on same project and this is my training code:
opencv_traincascade.exe -data hussein -vec sam.vec -bg neg1.txt -featureType LBP -numStages 6 -miniHitRate 0.999 -bt DAB -maxFalseAlarmRate 0.5 -numPos 900 -numNeg 2550 -featureType LBP -w 35 -h 62 -mode ALL -precalcValBufSize 1024 -precalcIdxBufSize 1024
and this is my makesamples code:
opencv_createsamples -info pose.txt -vec sam.vec -num 998 -w 35 -h 62
but my classifier is still wont work well.
last quesion:
How did you calculate minHitRate, numStages ,FalseAlarmRate, numPps and numNeg?
Thanks again
+Hussein Alaa
Here is the training code for stop sign (on mac):
opencv_traincascade -data data -vec samples.vec -bg negatives.txt -numStages 20 -minHitRate 0.999 -maxFalseAlarmRate 0.5 -numPos 800 -numNeg 400 -featureType HAAR -w 20 -h 20 -mode ALL -precalcValBufSize 5120 -precalcIdxBufSize 5120
You need more stages to improve the result, I chose 20 stages (in fact, at stage 16, the acceptanceRatio is 400 : 8.33416e-05, which means the result is good enough, a couple more stages won't help much).
Also, you might want to try HAAR featureType. LBP is good if you have high quality samples. The advantage of using LBP is not very significant in this stop sign case as it didn't take very long to train. Keeping your sample size small will reduce training time dramatically.
0.999 and 0.5 are the common values for minHitRate and maxFalseAlarmRate set in training. You can read some articles about adaboost to dig more.
Below shows the final training stage status of stop sign:
.
.
.
===== TRAINING 19-stage =====
Training until now has taken 0 days 0 hours 16 minutes 1 seconds.
Hussein Alaa I’m also working on a similar project. Can you send me the documentation for your project? I’m having problems with Numpy.
Outstanding performance..dude we all will appreciate it if you make a step by step tutorial..
Plot twist : a person is controlling that car remotely
😂😂😂😂lol
this was recommended to me 5 years later after the mario cart live bundle was released
promising signs for real self-driving cars in the future
really nice work bro
i was thinking about it that someone will definitilly have done it and then i find this video
Hello,randomly recommended video.
Great job brother I am truly amazed. I also thought of this kinda idea but didn't give it a shot.Great job man ,great job !!!!
The car is a paid actor. Same for the cameraman.
Now pack all this equipment inside the car and make it look like it's an ordinary car.
thats cool i like the sensors and the very smood movemen of the car.
Wow! The video is so sinematic
Brilliant Work, Dude!!!
great work. May you can add walking peoples on the crosswalk
Epic, Thank you for releasing the source code!
the equipment needed for autonomous driving is miraculously small
Nice project your efforts not got waste
oh the future same cartoon "Bakusou Kyoudai Let's & Go" LOL
Well this is a start for autonomous vehicles.
Nice Job and great Music;)
This really inspired me to make one for myself
Very great job man is impressionist
nice "toy" i want to play with this code =D
and great idea using an miniature car to test the code, its way cheaper and safer than testing in the real world
yo you used rasberry pi for that with freenova kit have the same thing! That's sick!!!
Fricking awesome ! Hats off dude.
centaurirobotics.in/learn/