Lane detection and object detection with OpenCV & TensorFlow

Поделиться
HTML-код
  • Опубликовано: 21 окт 2024

Комментарии • 177

  • @shashwatdalakoti4998
    @shashwatdalakoti4998 4 года назад +12

    I want to know what Fusion With Steering Advise feature has been smoking

  • @randomuser66438
    @randomuser66438 5 лет назад +190

    - Approaching truck on left Lane
    - "Turn left"

    • @lrdyeah
      @lrdyeah 5 лет назад +35

      WebDev feel like its just tellin you to stay centered in the lane the whole time, not really to change lanes, at least thats what i get from the crosshair in the middle of the screen

    • @randomuser66438
      @randomuser66438 5 лет назад +1

      @@lrdyeah To be fair I didn't notice that thing in there lol

  • @imkronos_me
    @imkronos_me 5 лет назад +117

    0:37 see the reflection on hood...

    • @amp08021
      @amp08021 5 лет назад +1

      Where's the issue?

    • @imkronos_me
      @imkronos_me 5 лет назад +22

      @@amp08021 motion tracking in reflection on hood!!
      Weird! ig!

    • @amp08021
      @amp08021 5 лет назад +1

      @@imkronos_me I don't think this should cause any problems though

    • @imkronos_me
      @imkronos_me 5 лет назад +49

      @@amp08021 i think the video is edited!

    • @Scafidi616
      @Scafidi616 5 лет назад +1

      Of course... the algorithm can detect the reflections, but if that would be real, it looks different... Logic

  • @newtonmunene
    @newtonmunene 5 лет назад +59

    I really wanted to see him change lanes

  • @yangding380
    @yangding380 3 года назад +2

    Could you tell me how much delay you have? That's from the time you begin to take the picture to the time the program identifies all the objects?

  • @JohnWayne99999a
    @JohnWayne99999a 4 года назад +2

    Is there any way to build a dashcam out of this?...I have been looking for a solution the whole day long and all I got is a major headache

  • @tien36326
    @tien36326 5 лет назад +2

    คนไทยสุดยอดครับ เป็นไปได้ ขอศึกษาด้วยครับพอดีกำลังศึกษาเรื่องนี้อยู่ :)

  • @vaibhavgoyal9056
    @vaibhavgoyal9056 5 лет назад +3

    It would have been nice if the the video was not sped up. What is the actual framerate you are getting at full resolution?

  • @mcmormus
    @mcmormus 4 года назад +5

    Can I find documentation somewhere? I would like to lern this myself, and this is the best solution I could find so far.

    • @reazonsraj
      @reazonsraj 3 года назад

      u can learning machine learning and deep learning he is opencv which is computer vision library for object car and lane detection u can learn it do learn machine learning and deep learning

  • @leonle2689
    @leonle2689 5 лет назад +3

    Goodjob mate! Btw, can you tell me which processor or pc that you used for processing thing? Thank you)

  • @jamespowell7231
    @jamespowell7231 5 лет назад +1

    I'm getting the idea that I need to build this into my windshield.

  • @maxfrischdev
    @maxfrischdev 11 месяцев назад

    That might sound weird, but watching this gave me the same feeling as watching some Superhero Movie where the power is released/revealed (or Dragonball Power ups😂)
    Awesome examples, just beautiful! Thanks ❤

  • @nightconceptproduction8299
    @nightconceptproduction8299 5 лет назад +20

    I already do that with my brain that’s why I’m Subaru’s finest rally driver

    • @陆奥
      @陆奥 3 года назад

      Niubility awesome

    • @o__bean__o
      @o__bean__o 3 года назад

      😒oh..god

  • @rajharry1378
    @rajharry1378 5 лет назад +5

    Awesome Work Man...Keep Going.....
    If you make some tutorials on this then it will be very useful for most of the Computer Vision enthusiast and beginners

    • @jamesbarker6373
      @jamesbarker6373 5 лет назад

      Open CV is open source. This guy didn't create it.

    • @rajharry1378
      @rajharry1378 5 лет назад +1

      Hey @@jamesbarker6373 !!!
      My interest is to know how he did the object detection.
      That's why I mentioned that tutorial for object detection like he did.

    • @jamesbarker6373
      @jamesbarker6373 5 лет назад

      @@rajharry1378 Google OpenCV. They have tutorials there.

    • @jamesbarker6373
      @jamesbarker6373 5 лет назад

      @@rajharry1378 docs.opencv.org/3.4/d7/d8b/tutorial_py_lucas_kanade.html

    • @rajharry1378
      @rajharry1378 5 лет назад

      @@@jamesbarker6373
      Thanks....

  • @Jay-uu5lu
    @Jay-uu5lu 11 месяцев назад

    How do you get it to do something like turn on a servo or turn on a light if it detects something like a car?

  • @Aol8887
    @Aol8887 4 года назад +1

    But why driving in the second lane when not passing?

  • @berkaykyoglu4936
    @berkaykyoglu4936 9 месяцев назад +1

    Congratulations for your works

  • @gafriglebit
    @gafriglebit 6 лет назад +6

    Very awesome update on your previous video!! Seems like you have been working hard at it, the interface looks very polished. Also appreciate your use of GH and open source, I'm sure the beggars will be working their way in blindly asking for the code. Looking forward to the next one! Cheers.

    • @sigmarulesog984
      @sigmarulesog984 3 года назад +4

      Oh wow. That's a lot of pride with as if you just made it to the moon.

  • @robinrai9794
    @robinrai9794 6 лет назад +10

    does it work on rain?

    • @humanity5175
      @humanity5175 4 года назад

      I guest , it is depending on the training data set

  • @老农民-zhao
    @老农民-zhao 5 лет назад +2

    For the objective detection, either YOLO algorithm or Faster region proposal CNN algorithm can handle that well

    • @mauriciocortazar9604
      @mauriciocortazar9604 5 лет назад +1

      Indeed. Tensorflow use Faster R-CNN, see the github repo

    • @和平和平-c4i
      @和平和平-c4i 5 лет назад

      @@mauriciocortazar9604 Why not YOLO instead ? Is there any advantage to use Faster RCNN that I dont know ?

    • @mauriciocortazar9604
      @mauriciocortazar9604 5 лет назад

      @@和平和平-c4i Althought YOLO is faster than Faster R-CNN, YOLO fails detecting smaller objects. Another reason is because YOLO is more recent than the former.

    • @empyrionin
      @empyrionin 4 года назад

      @@mauriciocortazar9604 YOLO V3 is now better at detecting objects of 3 different scales, including smaller objects due to some more downscaling layers added to it. This makes it slightly slower though. But you can't have both.

  • @Music-lv8xf
    @Music-lv8xf 5 лет назад

    is this the real speed of the video when detecting some lane? or anything that you present in this video??

    • @sebastianliendo6579
      @sebastianliendo6579 5 лет назад

      In the object detection case, processing one frame takes ~6 secs on CPU and ~0.8 on GPU,. The lane detection is fairly fast in terms of processing time. I don't know about the motion tracking though. Probably what he did is record the video and then post-process it...

    • @Music-lv8xf
      @Music-lv8xf 5 лет назад

      @@sebastianliendo6579 would mind check this code?? I am having a problem it consumes so much memory around 2gb and above i don't know why,
      private void timer1_Tick(object sender, EventArgs e)
      {
      using (Image nextFrame = captureIP.QueryFrame().ToImage < Bgr,byte>())
      {
      if (nextFrame != null)
      {
      // There is only one channel (gray scale), hence the zero index
      // var faces = nextFrame.DetectHaarCascade(haar)[0];
      Image grayframe = nextFrame.Convert();
      var faces = haar.DetectMultiScale(grayframe, 1.3, 4, /*new Size(nextFrame.Width / 8, nextFrame.Height / 8)*/new Size(420,300));
      foreach (var face in faces)
      {
      nextFrame.Draw(face, new Bgr(0, double.MaxValue, 0), 3);
      }
      pictureBox1.Image = nextFrame.ToBitmap();
      }
      }
      }
      private void Form1_Load(object sender, EventArgs e)
      {
      string facePath = Path.GetFullPath(@"../../data/haarcascade_frontalface_default.xml");
      haar = new CascadeClassifier(facePath);
      captureIP = new VideoCapture("rtsp ip cam link");
      }

  • @magi987
    @magi987 5 лет назад +7

    Can we have the full Surce Code

  • @mvndu2585
    @mvndu2585 5 лет назад

    correct me if im wrong;
    Using hough transform to detect the lines;
    using tensorflow api for object detection;
    and then what?
    please advice me on how to implement the steering advice method.
    all i can break from the video is : you are using the 2 lines to get the mid point between the 2 lines. and how does that work?

    • @jackpaul9393
      @jackpaul9393 5 лет назад

      ruclips.net/video/821ZnewFLcY/видео.html
      Watch this and view description for codes, I hope you will get clear understanding about this concept.

  • @luis96xd
    @luis96xd 5 лет назад +1

    This is so cool! Well done! :D

  • @alexhooper27
    @alexhooper27 5 лет назад +1

    That, sir... Was amazing!

  • @nate6692
    @nate6692 5 лет назад +2

    Let's see what it does in construction zones where the old lane markers veer hard right into a barricade.

    • @TheRealAfroRick
      @TheRealAfroRick 5 лет назад

      It would rely on object detection to know that action would be stupid.

  • @skyacaniadev2229
    @skyacaniadev2229 5 лет назад +1

    It seems that some of the predictions are dangerously wrong...

  • @1UniverseGames
    @1UniverseGames 4 года назад +3

    So cool.
    Can you please help me to get the source code for learn it.

  • @abraham1798
    @abraham1798 5 лет назад

    Fusion with steering advise is in track motion?

  • @mayankraj9864
    @mayankraj9864 6 лет назад +7

    Dear sir, How fusion of opencv and tensorflow works in real time with a webcam. Can you tell me the process? I am not asking for code but I wanna know how fusion works. or you have used the tensorflow output as the input for opencv for fusion. Kindly reply and guide.

    • @allmightqs1679
      @allmightqs1679 6 лет назад

      Mayank Raj fusion?

    • @ivarvaw
      @ivarvaw 6 лет назад

      He probably means: how to use a TensorFlow model in OpenCV.

    • @allmightqs1679
      @allmightqs1679 6 лет назад +1

      Oh? If that's the case it's a simple case of acquiring your data through openCV and using that as training data for your tensor flow model. Think of openCV as a glorified camera that takes snaps
      For example, the lane detection done is done using Lucas-Kanade method(irrelevant) and the cars are detected using tensorflow.

    • @covernhacvang6458
      @covernhacvang6458 6 лет назад

      @Ivar van Wooning This is guider video ruclips.net/video/mm8GWRRn9L0/видео.html

  • @kevinjia5432
    @kevinjia5432 5 лет назад +1

    I wander what the motion tracking is used for and how you accomplished it. That's about my research, please tell me. Thx

    • @o_poky9359
      @o_poky9359 3 года назад

      Google motion tracking. As simple as that

  • @leonkernan
    @leonkernan 5 лет назад +2

    So people see turn left and assume it means 90 degrees? It could mean turn left .01 degrees.

  • @amit_tiger63
    @amit_tiger63 Год назад +1

    Please send the code of lane detection

  • @sajjanpaudel3257
    @sajjanpaudel3257 3 года назад

    its soo cool bro! Hat's off!!!

  • @tanujkumawat5727
    @tanujkumawat5727 4 года назад

    Can u suggest the object detection course

  • @granatapfel6661
    @granatapfel6661 2 года назад

    Did you use exactly the code from the example?

  • @celvinwahyu2584
    @celvinwahyu2584 3 года назад

    how do you use the code? maybe you can make a tutorial

  • @lancereyesromero7811
    @lancereyesromero7811 4 года назад

    is there any way that you can run this through a mobile phone? I mean using your mobile phone's processing power. its a bit sci-fi but I want to make a helmet with an fpv screen. having camera's outside. day camera, night camera, infrared/thermal camera. oriented front, rear and sides. not showing all camera's at once. but you can switch between them wherever you want.

    • @lancereyesromero7811
      @lancereyesromero7811 4 года назад

      it doesn't need to identify every single thing. doesn't have to recognize the road. just vehicles and pedestrian.

  • @franklynxavier5643
    @franklynxavier5643 4 года назад

    Check this course for an in-depth explanation of OpenCV from beginner to advanced: ​ruclips.net/video/gLDJEY49M38/видео.html​

  • @ankitchawla6600
    @ankitchawla6600 5 лет назад

    Is there any other method except averaging out left and right lane separately ?

    • @empyrionin
      @empyrionin 4 года назад

      Inform lanes of each other and admit a maximum curvature, a minimum distance between lane separation lines and inform lane detection of likely lane shape, width and curvature from a GPS and a map. Many things you can do. Stuff gets messy when you have sun glints, reflections, wet asphalt, differing colors of concrete (bridge, roads repaired) or other lines such as tire marks. Honestly, pure OpenCV for this is not enough. You'd need a neural network too.

  • @prajitr21
    @prajitr21 2 года назад

    ผลงานเยี่ยมมากครับ ขอชื่นชม แต่ถ้ามาชนบท เส้นขาวตีมั่วไปหมด 555 เดาว่าคง error marking

  • @aditisrivastava7079
    @aditisrivastava7079 4 года назад

    This is simply WOW

  • @fasihuddin2620
    @fasihuddin2620 5 лет назад +1

    Hi I am working on OD project using Tensorflow OD api but getting an inference time of 0.22 second for single frame can you tell me how did you detect with this speed you are showing remainder I am on CPU

    • @sineme
      @sineme 5 лет назад

      if you are using a cpu instead of a gpu then that's the reason.

  • @samirosmanl4802
    @samirosmanl4802 3 года назад

    Sir I need tagged vehicle type dataset can you share a source?

  • @2699811
    @2699811 5 лет назад

    How can I find same input video?

  • @raghuveershinde5728
    @raghuveershinde5728 2 года назад

    Please Can you make complete tutorial on this how to make it
    And explanations

  • @Arrato1977
    @Arrato1977 5 лет назад +8

    can you make tutorial how you achieved these huge achievemenst ?

  • @郭权浩
    @郭权浩 5 лет назад

    how to do this in google colab,I want to use colab to do just like this

  • @EpicLPer
    @EpicLPer 5 лет назад +1

    This is definitely not in real time and rendered in after the footage was recorded... Still not bad but nowhere near "Tesla level".

    • @piexactlyequalsthree
      @piexactlyequalsthree 5 лет назад +2

      Tesla is still not bad but nowhere near space shuttle level.

    • @my3bikaht88
      @my3bikaht88 5 лет назад

      why not? you only need extra capacity for video coder

  • @alisatheeralap8763
    @alisatheeralap8763 2 года назад

    สวัสดีค่า เห็น Test ถนนในไทย อยากจะขอคำแนะนำหน่อยได้ไหมคะ ^^

  • @mybirds2525
    @mybirds2525 5 лет назад

    You guys need to add a time decayed persistence of objects in your process

    • @Bl4ck309
      @Bl4ck309 5 лет назад

      how in the world did you got verified with 28 subcribers

    • @mybirds2525
      @mybirds2525 5 лет назад

      @@Bl4ck309 Go get a life. Damned if I know!

  • @ClevelandBrowns32
    @ClevelandBrowns32 5 лет назад

    yea but how long to prcoess that video.....

  • @hfe1833
    @hfe1833 3 года назад

    What is your set up?

  • @JuanSanchez-rb4qu
    @JuanSanchez-rb4qu 6 лет назад

    Are you able to measure distances too?

  • @tuhinkumardolai9836
    @tuhinkumardolai9836 3 года назад +2

    sir where from we learn about it

  • @philippurwoko
    @philippurwoko 4 года назад

    Whats the music ?

  • @mambotrader
    @mambotrader 5 лет назад

    The direction was wrong

  • @nagarjunareddipaku678
    @nagarjunareddipaku678 5 лет назад +2

    Source code please

  • @o__bean__o
    @o__bean__o 3 года назад

    I think this features are not in Tesla car
    Nice work

  • @rajuyadav1271
    @rajuyadav1271 3 года назад

    Kindly share a video with live coding please

  • @zrlcproject
    @zrlcproject 3 года назад

    How it's work?

  • @dasport9677
    @dasport9677 4 года назад

    are that project need database

  • @lrdyeah
    @lrdyeah 5 лет назад

    What is motion tracking?

  • @devflugelo1914
    @devflugelo1914 3 года назад

    fps ?

  • @SivaneshMuneisvaran
    @SivaneshMuneisvaran 5 лет назад

    I want the tutorial..anyone can help me?

  • @boquangdong
    @boquangdong 3 года назад +1

    can you share me your code? this is it's a good project

  • @mch6645
    @mch6645 5 лет назад +3

    I don't think it's accurate enough. Your lane tracking method still needs to be optimized.

  • @mrlive221
    @mrlive221 5 лет назад

    Where I can find tutorial about tensorflow and opencv together?

    • @LeahLundqvist
      @LeahLundqvist 5 лет назад

      That really depends on what you want to do with it, any more specific details?

    • @mrlive221
      @mrlive221 5 лет назад

      hey thanks , i want to analyse video data with tensorflow

    • @LeahLundqvist
      @LeahLundqvist 5 лет назад

      @@mrlive221 then what do you need opencv for?

    • @mrlive221
      @mrlive221 5 лет назад

      @@LeahLundqvist ,i want to use tensorflow with webcame like for gesture recognition

    • @mrlive221
      @mrlive221 5 лет назад

      @@LeahLundqvist , do you know howto use both ?

  • @randomman3361
    @randomman3361 4 года назад

    Posted on 1 april, coincidence?

  • @masudofficial76news12
    @masudofficial76news12 2 года назад

    ❤️

  • @furkancoskun3505
    @furkancoskun3505 8 месяцев назад

    can you share your code?

  • @movocode
    @movocode 4 года назад

    source code?

  • @MrMBSonic
    @MrMBSonic 5 лет назад

    Awesome

  • @析言
    @析言 5 лет назад

    it's cool ,bro

  • @dasport9677
    @dasport9677 4 года назад

    i need good course to make a good project like that

  • @yiyangpeng5758
    @yiyangpeng5758 5 лет назад

    car's ap is too low

  • @papaassanediop2538
    @papaassanediop2538 3 года назад

    code source ? svp

  • @stevesingh104
    @stevesingh104 4 года назад +2

    Hello it was amazing could you help me to make this project

  • @mugg8516
    @mugg8516 2 года назад

    Cool, change lanes, thas really cool, lol

  • @damianwysokinski3285
    @damianwysokinski3285 5 лет назад +1

    Aimbot activated

  • @aydinaltun3816
    @aydinaltun3816 3 года назад

    i did similar thing on Carla simulator

  • @ktpchannel6184
    @ktpchannel6184 5 лет назад

    เจ๋งมากคับ

  • @moazelsawaf2000
    @moazelsawaf2000 5 лет назад

    Great ❤️

  • @gunip.7109
    @gunip.7109 6 лет назад

    ติดตามครับ​ อยากได้ความรู้เพิ่มเติม

  • @dr.mukulkanojia
    @dr.mukulkanojia 5 лет назад

    Ya, do that on a foggy day...

  • @zenhsuld
    @zenhsuld 5 лет назад +1

    Great.., can u share source code

    • @allmightqs1679
      @allmightqs1679 5 лет назад +1

      But it's really really easy. Why do you want the code?

    • @priyanandamuri226
      @priyanandamuri226 5 лет назад

      did u got the output?

    • @allmightqs1679
      @allmightqs1679 5 лет назад

      @@priyanandamuri226 yeah

    • @priyanandamuri226
      @priyanandamuri226 5 лет назад

      can u give me ur contact number?if u dont mind...because iam doing this as my final yearB.Tech project..i want some help :) plz rply me fast

    • @Trtko-y2p
      @Trtko-y2p 4 года назад

      @@allmightqs1679 no.

  • @user-vm9gx4so4x
    @user-vm9gx4so4x 4 года назад

    с вертолета с машины обнаружили устройствам передали и т.д. это мы не умеем.

  • @kavinkumar7591
    @kavinkumar7591 5 лет назад

    code

  • @pastuh
    @pastuh 3 года назад

    turn right :))))))))

  •  3 года назад

    Like technology opencv

  • @nkpenn
    @nkpenn 5 лет назад

    predict something moving on freeway only 50-60% chance to be a car? How stupid is the algorithm

    • @q009q009
      @q009q009 5 лет назад

      @Kevvy Kim idk, Tesla's system is accurately able to track many objects very well. So it certainly is possible...

  • @anikevin
    @anikevin 3 года назад

    1:19 bruh

  • @fpgamachine
    @fpgamachine 5 лет назад

    Too sentimental..

  • @จิมจะบ้ง
    @จิมจะบ้ง 3 года назад

    ช่องของคนไทยป่าวครับเห็นชื่อเหมือนคนไทยเลย

  • @kanjiladva7635
    @kanjiladva7635 5 лет назад

    Judgment day is coming soon guys lolz

  • @СуперПупер-ю1ы
    @СуперПупер-ю1ы 5 лет назад +1

    чушь какая-то.

  • @gbroton
    @gbroton 5 лет назад

    Just Google Comma.ai

  • @jordanvail9749
    @jordanvail9749 5 лет назад

    Hi there! I work for Catch&Release, a tech company that finds and licenses online content for use in ad campaigns. We're working on a new ad and we'd love to use a clip from this video! Please email me at jordan@catchandrelease.com for details, including payment. Thanks!

  • @Al_skeptical
    @Al_skeptical 5 лет назад

    Python

  • @ddossexhot136
    @ddossexhot136 4 года назад

    thaiii
    *--*