How do self-driving cars “see”? - Sajan Saini
HTML-код
- Опубликовано: 15 окт 2024
- Take a look at the LIDAR and integrated photonics technologies that help self-driving cars navigate obstacles, no matter the environment, weather or light.
--
It’s late, pitch dark and a self-driving car winds down a narrow country road. Suddenly, three hazards appear at the same time. With no human at the wheel, the car uses smart eyes, sensors that’ll resolve these details all in a split-second. How is this possible? Sajan Saini explains how LIDAR and integrated photonics technology make self-driving cars a reality.
Lesson by Sajan Saini, directed by Artrake Studio.
Learn more about integrated photonics: aimphotonics.a...
Learn how integrated photonic chips are made: www.aimphotoni...
Sign up for our newsletter: bit.ly/TEDEdNew...
Support us on Patreon: bit.ly/TEDEdPat...
Follow us on Facebook: bit.ly/TEDEdFac...
Find us on Twitter: bit.ly/TEDEdTwi...
Peep us on Instagram: bit.ly/TEDEdIns...
View full lesson: ed.ted.com/les...
This narration and animation can make anything interesting
Next “the science of taking a poop” or “how to make an average sandwich”
IKR. Like I wish we could like watch videos in school like this! If we did I would be able to learn a lot better. I would be making 100 A's.
I love the narrator's voice too
Ted-Ed always coming with the answers to question I ask in my head but never say out loud
Yoi banget
MATH Genius that was beautifully said
The funny thing is that Tesla don't use Lidar due to its high cost and low reliability
You really pretty Dani
Thank you for shortening down to 5 minutes almost the entire course of MS Optoelectronic i took this year. Amazing how concepts such as a MZ modulator and integrated photonics can be explained in such an easy way.
Ted Ed is phenomenal. I’m constantly impressed and thankful for your work in making knowledge so accessible and digestible. I’ve learned so much from watching this channel, and your videos have prompted me to delve deeper into different topics I don’t think I ever would’ve gotten the opportunity to. Thanks for all your hard work❤️
I love the tone of this Narrator the most, I could listen to him all day
*A better question*
How does a Tow Truck drive backwards at 80 km/h and becomes a secret agent
The best movie.
I understood that reference
Great job, you have done a great deal of emphasis on the sensor part of a self-driving car. However, you did not mention at all the decision-making mechanism, which is in my opinion, the real challenge of self-driving, I think that video on deep learning would be highly appreciated.
Self-driving car: "sees" a pedestrian with a club
Self-driving car: "Why do i hear boss music?"
self-driving car- *switches to manual
gamer in car-*it's showtime
The club: Alright! Here we go again
@Aaron Yu **Jazz music stops**
purification in progress
Ted-Ed describes things with so much detail in a way that no other science youtube channel does. Thank you for that. You are an amazing teacher and educator
Ted-Ed always answers my everyday questions. What a splendid RUclips channel!
Yeah except...visual resolution of lidar (like color) is abysmal-especially for now. Like Elon said, the roads are made for eyes: rely on vision first, supplement with lidar and ultrasonics. I do have to say, mega respect to Ted-Ed, and it’s cool that they talking about the actual electronics of it.
Then maybe pursue more scientific qualifications and publish a video yourself?
Lidar doesn't have anything to do with color. It just generates a point cloud that is converted to a 3d image
Real N He does have a point though, while Lidar as a technology is cool, camera technology is getting to a point where it’s no longer necessary.
@@jerry3790 LIDAR is inherently better. With camera you're making the machine operate as a human would. That's like designing a car with legs.
Sure, it would be cool. I love AT-ATs. But wheels are just so much more practical on a machine. Let a machine be a machine and not emulate nature when there is a better way. Eventually I expect to use a combination of LIDAR with camera backup for extra safety. An IR camera that sees through fog and in pitch darkness that is.
LIDAR is better for depth resolution than stereoscopic photogrammetry. Sensor fusion wouldn't be and issue since the sensors and camera are static relative to each other
wonderful animation as always!
I have seen CARS movie enough times to believe cars have eyes in their windows and the ventilation as their mouth
Makarov -Father of fairies top ten smartest people in the world
👌🏻👏 congrats 🎉
Yes and I can feel whether the car is angry or happy.
Havent thought of this before! The scientists and engineers who invented LIDAR are really innovative. Can LIDARs see color too?
As someone who doesn't drive for health reasons and wants a fully autonomous vehicle in the future, this was really informative on how self-driving cars actually work! Thanks Ted-Ed :)
But Tesla doesn’t use Lidar, so we need another video
Yup. Elon does not like LiDAR
He is using golems
They need another title like "HOW LIDAR WORKS". Self driving is not exclusive to cars using LIDAR.
@@jasperizak123 That's not true at all. They implemented it into the Dragon Cargo to dock with the ISS. He just said it's useless in a model driven by cameras and neural networks.
how do you know 🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓
무인자동차가보는 방법을 구체적으로 배워보는 좋은 시간이 되었습니다. 무인자동차의 과학적원리가 참 대단해 보였습니다. 저의 궁금증이 하나 더 해결되었습니다. 좋은 영상 감사합니다.
Some of the best narration on RUclips
This channel deserves more likes and views.
TED-Ed awsering question, that i may never use in real life.
This why they're the best!
What a great and simple explanation of solid state lidar, I am impressed!
4:58
Person who manufactured the car: "Am I a joke to you?"
Machines do most of that work as well to be honest.
@@ghostderazgriz But their work cannot be counted as labour.
@@stormysamreen7062 exactly?
Another gem from TED after long time 💎❤️
어릴 때는 공상과학 영화에서만 나오는 내용이라고 생각했지만, 지금 실제로 시험 운행 중에 있는 자율주행 자동차들을 보면 정말 기술이 많이 발전했다는 것을 느끼고 있습니다. 저는 자율주행 자동차들이 내장되어 있는 카메라로 주변 환경을 본다고 생각했는데, 이 영상을 보니 오히려 박쥐가 초음파를 이용해 길을 찾는 방법과 더 유사한 것 같습니다. 유익한 영상 감사합니다!
Keep posting these type of animations to help us learn practically......
Good learning....ted make rockz...brave voice. Clear and sharp to listen..
keep up the good work, thanks for explaining complex things simply,
I highly recommend Lex Friedmans series on autonomous vehicles. Great introduction into the self driving space.
A vey satisfying video.
*They are watching us - ALWAYS*
I think we can all agree that, this person is our favorite ted-ed narrator.
Forever answering questions I never asked but am fascinated by the answer
We take technology as granted we don't realize how complex it is until someone make video like this.
Maybe not all.
As always sooting voice of narrator and intelligible animation
👌
I love you people who create this video.
That is actually a question I still wonder until now, though, thank you.
The best answers and information
1:53 I would suggest thickening the beam, and using a color other than green to represent light bouncing back. The green beam is harder to see because it is against a blue background, and it practically disappears if viewed on the lowest resolution, 144p.
Crazy! These people are incredible
Ted Ed needs to open a school these vids are so great
You are best at explaining
Damn ! You're uploading this video right after i created a self driving car program !
thanks ted-ed i was planing to make a project on it and you just made it more intresting
I studied physics then dropped out of my full ride with my kid years ago. I did develop an ego because of it because I thought I knew everything. Finding years’ old videos of Ted that I hadn’t realized I missed completely, I realize I know nothing.
So when these things grow in popularity, how safe are they going to be for incoming traffic? When I'm driving down a single lane highway and someonens coming at me with their headlights on its uncomfortable for a few moments. But if I'm constantly exposed to lasers as I meet these vehicles on the single lane highway what will that do over time to my eyesight?
This makes you appreciate your eyes. Your eyes and brain does this naturally.
TedEd astounds yet again!
#TedEd-at-its-best!
2:27 "Use something else"
Literally
Oh I just noticed that it's labeled that way xD that's hilarious.
Another amazing video with great animation ted-ed...
Iam fan of your channel.. It gives me more knowledge
Thank you ted-ed...🙏👍
My IQ has risen! Thank you for answering the questions I ask myself in my head!!!!
‘Anyone relying on lidar is doomed,’ -Elon Musk
Daamn, J'allais dire la même chose!
@@karasira2696 trop tard
Exactly what I thought 😂
77
LiDAR is not the only solution to self-driving. It has a lot of advantages, but also just as many disadvantages. The sensors are very expensive. Resolving the detailed features of objects in front of it is not very precise from off-the-shelf low-res hardware which a lot of these cars are equipped with. Plus, the current transportation infrastructure is created for visual perception, because it's driven by people who use visual perception to navigate vehicles; there is something to be said for a solution that uses visual data to navigate over LiDAR.
thanks for the lesson ted
_HOW DO SELF-DRIVING CARS "SEES"..._
*Pixar:* Hold my vodka
Lol
Good one...Lol.
*As our mobile phones know where we are, where we should go and where is the nearest coffee shop.*
We are being constantly tracked.
I wonder what quality content I would watch if Ted Ed didn't exist?
2020 vision?
I see TED-Ed is cultured organization as well.
I can’t see into the future because I don’t have 2020 vision.
Love your animation 😇 and the narrator.
I like your videos so much it really is a great educational channel
Mesmerising !
My English is bad , so... hope you guys can understand my meaning ,
I have a question , if one super short laser into the another LIDAR system will have problem?
it is just awesome
How it would detect fast moving obstacles like an animal running across the road ,we humans will switch to right if it's running from right to left ,but what will the automated car do ? Will it automatically stop until it crosses?
I've literally been asking this question in my mind a lot haha!
Brilliant video. But i believe detection is not the main problem currently, but the main problem is to identify and track objects reliably. And also the ethical dilemma (which is already explained in another ted-ed video).
Nice, I work with lidar to use on self driving car in California
Except Tesla doesn't use Lidar and is the best self-driving car on the road today
Tesla cars aren't self driving, only Level 2
@@jojodroid31 Elon Musk is offended by this video. He shat on Lidar at the latest tesla presentation xD
Lidar is costly, heavy and bulky, and not completely reliable. Elon is right
@@shivamtyagi677 From your answer I recon you watched Real Engineering's recent video.
Isn't that mostly a cost question though? If you'd build self driving car with all the best tools, no matter the cost, LiDAR would probably be used. Sense Tesla also want their cars to be affordable, they're using technologies that are cheaper to implement today, at least that's what I've heard.
Once LiDAR becomes more affordable and possible at size scales described in this video, Tesla will probably switch to use LiDAR, but will probably still use their software that they're currently pushing to develop and refine.
Nice presentation, but the real question is what happens when multiple lidars interfere with one another. The chances are low because of the time scales, but if there's a sufficient number of self-driving cars, there's got to be lidar pulse sync at some point between 2 or more cars.
We are assuming that 3 obstacles stay still. What if that deer get panic and jump suddenly or a car appear out of a corner ? Is the car be able to see it coming ?
Then you blame the deer.
Good video
I love those quotes before videos 📕👏
Quite interesting. Top-notch narration and animation. Loved it❤
this is some hardcore electrical engineering, humans did come a long way
TED-Ed again with super simple animation and great explanation, Keep Going >>
Oh nice one of the first time to be here so early
“Imagination is more important than knowledge. For knowledge is limited to all we now know and understand, while imagination embraces the entire world, and all there ever will be to know and understand.” - Einstein.
I wish it's applicable to blind people for navigation especially on detecting the height of obstacles... So they know what next step is... Well, there's a limit to everything
wow thank u so much sir
So, why do the cars need such fine vision resolution? If something is smaller than a few centimeters, it can probably be ignored.
thank you TED-Ed for this wholesome break from the James/Tati drama
I got a self driving car ad before this!
Amazing 👍🏻
I'm actually a team leader for a self driving racing car competition in the UK 'FS-AI'. This is a top quality video, however, LiDAR hasn't quite been explained perfectly becuase even the best LiDAR radars only see a very limited slice of the world. Whilst we have LiDAR it's kinda useless, the limited slice that the LiDAR can see makes it very difficult for object recognition as there simply isn't enough data coming from the LiDAR to make any reasonable assumption of the object. We use the Robosense V16 Lidar, which, despite it's high price tag is simply not useable. To get better resolutuion you have to pay vast amounts of money even though they fundemantly have the same issue. What we use instead is stereo vision (Zedd Camera) as you're able to make better object detection useing each image from the camera and using machine vision and the principles of the Fundemental Matrix, we're able to rebuild a higher quaility map of the world.
But zedd cam that doesn't imtegrated by some kind of 3d lidar, doesn't give accurate results especially under extreme weather conditions. How did you manage to do that?
@@selene8734 Firstly, neither does LiDAR in those situations. We solved it using multiple cameras, and a model train on sensor fusion for the various weather conditions
Nice video, worth Watching :)
When the laser bounces off of things, doesn't it travel away from the laser?
How does the car receive the laser? Does it really travel straight back, even when the surface isn't perpendicular?
part of gets deflected and some traces back the same path
Thank you
How does a Lidar system distinguish between its own reflected impulses and ones emitted by an ongoing car which is suited with the same system?
Collecting cloud of several million precisely positioned 3D points is kind of easy. Figuring out the actual object from that cloud, now THAT is a challenge!
Good video! I subscribed and liked!
If the road is full of self-driving cars using LIDAR, will they wrongly detect the others' signal and cause accident?
Awsome work❤
Hey @Ted-ed, how come light Ray possibly get reflected and absorbed in a sensor, Radar, sonar works on the reflection of the waves, but how come light???
light ray, radar, and sonar are all waves. They are same, they work the same way. Can you ask again what you're asking?
Self-driving car: *sees an insect 10 meters infront.*
Self-driving car: *Drifts like Vin Diesel.*
Whatever a Mach-sender modulator is, it sure sounds like it is cool
I'm purchasing this car....
I'm gonna take my *self driving car* to the old town roooooad
Being the best in pioneering self driving currently, Elon Musk doesnt support Lidar in cars. He says its worthless and that cameras are far better. Elon also said that he isn’t against Lidar, as SpaceX use them for space station docking, but it just doesnt make sense in cars.
was about to comment this. thanks for educating others :) Elon Musk rocks!!!
The problem with Lidar that Musk describes is that they are (currently) expensive and large. However, in the near future devices such as those shown in the video will become available, probably at a fraction of the current cost of lidar systems. At that point, any autonomous vehicles would probably choose lidar's superior accuracy and depth perception over the advantages offered by cameras.
@@JWFitz I am pretty sure they are just going to use both.
@@JWFitz just "seeing" the object is HALF the battle, then you need to identify what it is... think a plastic bag blowing across a highway. Telsa is using cameras (with color) and big data to solve the second half of the problem. They have billions of miles worth of data identifying animals, people, bikes, etc... where the companies using Lidar only have a depth map.
@@stachowi no they don't what age you smoking they just have video footage no one is going to label billion miles not video by hand you Dumbo
I love ted ed 💞♥️😍
Doesn't short wavelength allow us to see more details than long wavelengths?
118 liker and 7 minutes ago uploaded AND NOTIFICATION SQUADD!!!