I doubt it would look different in this visualisation. It's just a threshold on the speed difference and distance which issues the crash prediction warnings.
@@TheSuperCoolMan122 haha , srsly siri will never be able to open settings,let alone developer console. Also u should have said Google assistant and i might agree
This is just so cool. The car is so fast at recognizing everything. I love how it puts a cube around the cars so it knows approximate size not just where it is. And the green driving area is super impressive. It knows past the lines is driveable, but the median is almost perfect detected and not driveable.
Their new computer can process 2000 frames per second at 4K. It is several orders of magnitude faster than this. Tesla managed to create the fastest chip for this task, beating NVidia.
@@aggelossofos123 Not a single person has a retrofitted FSD chip right now. They've publicy stated the first retrofits won't happen for another 2-3 months minimum.
@@dylanstarling7143 Everything you see on the screen that the computer identifies, we too subconsciously or consciously observe and identify what vehicles are doing while we're driving. we process the same things the computer does.
I actually thought about that as well, it's insane how far we've come and even more so when thinking about how it will have been improved within the next decade.
Did you even open your eyes before you commented that? You can see it detects it right infront of you. It creates a red box around it for a short time. Then you even liked your own comment because you believed you were so right. Lmao, idiot.
@@PlexHvH wow so much salt. What I meant by detection was, there was no consistent visual markers for the bumps, which made it seem like the car only slowed down because there was a vehicle in front of it. Even if it did have a red box (which you could have just timestamped because I obviously didn't see it), it was not consistent, given there was more than 1 bump. And no, my statement was not a fact, given it had a question mark at the end, which renders the "you believed you were so right" invalid, because you know, it's a fucking question. 'Lmao, idiot'....... fuck off you ass, I liked my own comment only so that my question would be a little more visible against the sea of other comments so that my question would be more likely to be answered.
Can you show a drive in a city with the ultra wide camera (the fisheye one)? I'm curious how good the Tesla can pick up cars on intersections when it has to stop and yield.
This verifies a concern I had; autopilot does not recognize that it is an EMERGENCY VEHICLE, which almost all jurisdictions require you to keep XX feet away when following. So autopilot doesn't follow the law, or allow manual setting (like max speed) to do so.
@@qinn1996 Law or not is should be able to see it is a fire truck. Emergency vehicles tend to make erratic decisions. Also it did not recognize the turn signal. I really don't see how this will be ready in a year for full auto. Unless this data is from a year or 2 ago.
there appear to be some beginnings of handling emergency vehicles mostly by the blinkenlights in the NN, but it does not appear to be used at present so it is seen as a regular truck/bus for now
I don't think it recognizes signalling but, man, that firetruck signalling right but turning left would have been a terrible thing if it counted to the AI autopilot
This is a single camera footage in this video so your question does not really make sense. That said all cameras have the same 36 fps except the backup cam in S/X cars where it is at 30fps
Ah. Then there is a lot of room for improvement, especially in the end of the video for opposing traffic. The new pseudolidar object detection should improve this great or maybe just enough more data and full resolution with AKNET_V9 will do it!
Is it driving on AP or just what is viewed in shadow mode? Also is that really a firetruck? It looks more like a regular truck, as it is carrying logs.
it is a fire truck. I can probably publish the sidecam footage where it's better seen as such. see the steering wheel icon to the bottom right, when the background is blue, the car is on autopilot, when it's gray, the driver is in full control.
@Price McTavish If it's red, stop. If it's green, you go. If it's amber, you determine if you have enough time to come to a safe stop. If you do, you stop.
What would happen when you would print the back of the firetruck on a big poster and start walking with this board? Would it think you are a firetruck :P?
In certain circumstances yes, if the car "sees" you straight from your back, and you have a real size cardboard truck profile behind you. But if it sees you from an angle it will understand you are not a truck but just a funny human.
I don't have a writeup, but tencent has some in their past two reports. Unsigned code execution is easy on infotainment (unless you have a 3 or MCU2, then it's a bit complicated) and quite a bit more involved on the autopilot unit (but still possible)
Pretty cool to see an equivalent of the development version - I'm impressed that you guys pulled this off. Have you considered working with Tesla? It would be interesting to see what it looks like with the newest version of the NN. If we are to trust Elon's verdict, the new FSD hardware probably won't make a significant difference for a few months, as far as the NN is concerned - except the FPS would obviously be much higher. Looking forward to any further content you can release from your rooted Tesla!
It's not just higher FPS. They have a whole separate branch of software in the works for FSD. The FPS measurements were just to give a baseline of running existing EAP on nvidia you get X, if you ran it on the new chip you get Y frames. They will definitely blow past the nvidia capabilities for FSD and I'd bet money you can't enable FSD without the new computer.
@@jameslporter We agree that FSD will not be enabled without the new computer, as Tesla has officially stated that people who bought FSD will have to switch to the new computer in 2-3 Elon months once their software and NN is superior enough to no longer be supported on the 2.5 hardware. But I was referring to running the current software version on FSD hardware, which I think would primarily be frame rate increases. I would speculate similarly about their separate branch of software for the FSD computer as Tesla loves vertical integration and dedicated software, but I have no direct evidence. Do you?
He has root-access to the car, i.e. hacked into it. Also as far as I understand, this view doesn't come from Tesla directly, but greentheonly (and others?) wrote the software to render raw numbers coming in onto a video like this.
Interesting. Seemed quite robust for such a rare truck but a momentary partial occlusion made it completely forget about the large stationary truck. Cars in opposite direction were not robust though. Btw is there a single frame offset in the classification? seems there is a slight lag.
there's a bit of offset, yes. Plus detections on the cam are different than framerate and when you compound that with how 36fps is translated to 30fps by framedropping it's compounding the issue some. Good thing Elon is on record to say this functionality comes to all cars, though, so everybody would be able to generate footage like that. Eventually. May be. ;)
@@greentheonly thanks for the work. Very insightful. Should be very interesting to see the next feature release. Might just be traffic lights. To do complete autonomy it would have to see everything basically. A football, a road block, large pothole, flooding, ramps. Toddler on a trike. Seems a ways away.
but what's the point? My car is a lease that runs out in under a year. If there's some material FSD change in that timeframe without hw update - I'll make something up then. Right now there's no need to worry about it at all.
It is impressive, but there didn't seem to be any recognition of the stop lights or signs, so which software version is this? I'm given a warning if I'm about to run a red light, so clearly the NN recognizes them.
The recognition is there, just have not bothered to fully decipher how it shows and adding icons. There are not going to be bounding boxes because they do it as entire picture properties instead.
I'd absolutely love to see this debug screen in a crash prediction scenario.
That is what AI is doing at the moment. Analyzing all potential scenarios
Yepp going crazy
@letter h lol
I doubt it would look different in this visualisation. It's just a threshold on the speed difference and distance which issues the crash prediction warnings.
Why does a Tesla have ESP and wall hack? Does it come with aimware too?
agentroadkill teslas are a paste
give me subscribers plz thanks Boogerhook
Esoterik made it
p car resolver and p visuals
@@dreamfixx skeet is dogshit atm
It’s kind of amazing how much information it is processing at once
Not really all that much compared to other programs
Still worse than a brain
@@jojodroid31 bold of you to assume some drivers aren't already braindead.
Butterworth Filter i mean if you have a car that has autopilot probably means your not braindeead
@@jojodroid31 not for long
Looks like aimbot for real life lmao
siri open developer console
You mean looks like a Wallhack/ESP.
It is
@@Northernliiights this^
@@TheSuperCoolMan122 haha , srsly siri will never be able to open settings,let alone developer console. Also u should have said Google assistant and i might agree
Target locked... Autonomous stalking mode activated.
I heard that fire engine is still indicating right to this day
Woow...
Wooow....
Wooooow......
wow
Wooow...
I don't know why watched the whole video and find it so interesting
This is just so cool. The car is so fast at recognizing everything. I love how it puts a cube around the cars so it knows approximate size not just where it is.
And the green driving area is super impressive. It knows past the lines is driveable, but the median is almost perfect detected and not driveable.
And this is with the old 2.0 hardware computer, the new FSD computer is a lot faster and smoother at pattern recognition.
Wonder if they programmed in the potential for a .5 Kg bird hitting the windshield?
Their new computer can process 2000 frames per second at 4K. It is several orders of magnitude faster than this. Tesla managed to create the fastest chip for this task, beating NVidia.
you need to get the new full self driving chip installed! imagine how much smoother it will be!
Tesla refuses to sell me one.
greentheonly with what excuse?
They claim it's out of stock at my service center.
@@aggelossofos123 Not a single person has a retrofitted FSD chip right now. They've publicy stated the first retrofits won't happen for another 2-3 months minimum.
Tesla/Elon tend to say one thing in public/on twitter and do completely another one in private.
This is the beginning software for a TERMINATOR.
Jajahhaaahhaa yeeepp
Give it 15 years and they'll have just about every scenario you can think of.
@@DjinnsĘnigma they allready have, not available for regular citizens
I want to see this debug screen in a demolition derby scenerio that the car doesn't know it's in 😁
0:30 He's an impatient little one isn't he?
So fire truck made a left with right blinker on?
Firetrucks are amazing like that I guess.
It's crazy how many calculations are going on per second
Its creepy
@Big Smoke not really we humans are focusing on things it would be to much informations for our brains
Just follow that damn truck, CJ!
all you had to do was follow the damn train CJ !
Aww man here we go again.
Imagine the orange line is a tongue
Gappie Al Kebabi
Wtf how is it filthy? It’s a joke.
That's insane how quickly it detects anything and everything even the fucking speed bumps jesus elon musk is a genius
No, reCAPTCHA is the reason, all those time you've entered a password secured with it! You have made cybernet without even knowing!
Harry 8642 is that true ?!
@@enterIT-xl8cc yeah, search up about it haha.
@Giovanni According to that logic, Jeff Bezos is was at my door earlier delivering my Amazon package
@@HarryL2020 nope this isn't true. Google won't actually give Tesla the data unless they agreed to do it so
I cant imagine the processor doing that... must be at 101%
www.theverge.com/2019/4/22/18511594/tesla-new-self-driving-chip-is-here-and-this-is-your-best-look-yet
no, this is video is on old nvidia chip based unit
@@greentheonly Cool
Firetruck: Indicates Right...
*Goes Left*
It's amazing how much information we process everyday.
What?
@@dylanstarling7143 Everything you see on the screen that the computer identifies, we too subconsciously or consciously observe and identify what vehicles are doing while we're driving. we process the same things the computer does.
Rythblaqk oh cool
Gappie Al Kebabi is there something wrong with you
This basically is a small portion of what our brain is doing all the time visualized 🤔
Imagine putting this inside a helmet and feel like your Tony Stark lmaoo
(Sorry for ma bad english, i’m swedish lol)
Underrated comment
I actually thought about that as well, it's insane how far we've come and even more so when thinking about how it will have been improved within the next decade.
Is that really what the camera and sensors see?
OpenCV?
hmmm, no detection for bumps at 1:18?
Did you even open your eyes before you commented that? You can see it detects it right infront of you. It creates a red box around it for a short time. Then you even liked your own comment because you believed you were so right. Lmao, idiot.
@@PlexHvH wow so much salt. What I meant by detection was, there was no consistent visual markers for the bumps, which made it seem like the car only slowed down because there was a vehicle in front of it. Even if it did have a red box (which you could have just timestamped because I obviously didn't see it), it was not consistent, given there was more than 1 bump. And no, my statement was not a fact, given it had a question mark at the end, which renders the "you believed you were so right" invalid, because you know, it's a fucking question. 'Lmao, idiot'....... fuck off you ass, I liked my own comment only so that my question would be a little more visible against the sea of other comments so that my question would be more likely to be answered.
@@grenzviel4480 LMAO, you timestamped it yourself you keyboard warrior. Stay in the basement kid.
@@grenzviel4480 LOL, I GOT IN YOUR HEAD
How to you get video like this?
teslamotorsclub.com/tmc/threads/seeing-the-world-in-autopilot-part-deux.129790/
This looks alotlike terminator
_Do you want me to engage enhanced combat mode?_
Looks like Terminator's pov
The tesla mapping gives me anxiety
*This takes salking to a whole new level*
Can you show a drive in a city with the ultra wide camera (the fisheye one)?
I'm curious how good the Tesla can pick up cars on intersections when it has to stop and yield.
Everyday life of Tony Stark when his sunglasses is on.
This verifies a concern I had; autopilot does not recognize that it is an EMERGENCY VEHICLE, which almost all jurisdictions require you to keep XX feet away when following. So autopilot doesn't follow the law, or allow manual setting (like max speed) to do so.
never heard of that law though
@@qinn1996 Law or not is should be able to see it is a fire truck. Emergency vehicles tend to make erratic decisions. Also it did not recognize the turn signal. I really don't see how this will be ready in a year for full auto. Unless this data is from a year or 2 ago.
You're only required to stay back from an emergency response vehicle when it's lights and siren are on.
Anyone else notice how long it took for the autopilot to reaquire the silver car at 0:19 as an obstacle?
Tesla owner: Whistling🎶🎶...
Model 3: "I need your clothes, boots and your motorcycle"...
Tesla owner: WTF DUDE???😱😵
Me: Bwahahaha😂😂😂
How oldnare you? 12?
@@hansdietrich83 "oldnare" yeah right you genius smh...
i would love to see debug on the HW3 computer!
At 2:03, what quick decision making by the vehicle! I personally would have cut him off though lol
Does the car know that its a fire truck and not just a regular truck?
This way it can pullover or clear the way if under emergency.
The car sees it as a truck. You can read as what the car sees the other vehicles.
there appear to be some beginnings of handling emergency vehicles mostly by the blinkenlights in the NN, but it does not appear to be used at present so it is seen as a regular truck/bus for now
There appears a bit of that too, but turn signal is not something that is a very certain sign for future car behavior.
the emergency vehicle kind of blinking lights.
It's not really outlined anywhere in the video. What I mean is there appears to be (not so active) code to handle this.
I don't think it recognizes signalling but, man, that firetruck signalling right but turning left would have been a terrible thing if it counted to the AI autopilot
I love how spastic the software goes spastic trying to figure out if it’s a car or a minivan
Interesting event @2’05” where the human stopped to allow another car in out of courtesy. How do you program for that odd event ?
How do you enable debug output?
Приятно глазу видеть не то что терминатора. Приятно видеть хорошие дороги.
Pretty cool. I have a 60000 vin model 3. 2018. Do I have the fsd chip needed for when they go full self drive. ?
You'll need a retrofit once Tesla offers it. Which noboy knows when it will actually happens if at all.
What if a fire truck is behind the Tesla with sirens on
Would love to see more videos of all the cameras on the latest software!
it's not really much different from before.
Nice sound!
Do the front cameras have different fps or why are some cars at the sides flickering more than some in front?
This is a single camera footage in this video so your question does not really make sense.
That said all cameras have the same 36 fps except the backup cam in S/X cars where it is at 30fps
Ah. Then there is a lot of room for improvement, especially in the end of the video for opposing traffic. The new pseudolidar object detection should improve this great or maybe just enough more data and full resolution with AKNET_V9 will do it!
Is it just me, or does the Tesla pull up pretty close to a big vehicle (ie the fire truck)? It could just be the camera lense.
It's an AI that is largely trained by real life drivers so it pulls up just about an average amount i guess
This is what the terminator sees.
Good program for all the ambulance/firetruck chasing do gooders.
Why is there wood on the fire truck?
do not read my profile picture
XD I see. Thx.
How did you get this view?
teslamotorsclub.com/tmc/threads/seeing-the-world-in-autopilot-part-deux.129790/
What is the difference between stopped and stationary?
stopped = we saw it moving, but not it does not
stationary = it never moved as much as we can tell.
This designation comes from radar.
Autopilot be like--- "these damn HUMANS,can't even drive properly,Look where u parking"
if u install this sytem in a mustang it will crash into everything
Auld Kendal lol
It would have two categories of objects: ,,pedestrians" and ,,other"
Is it driving on AP or just what is viewed in shadow mode?
Also is that really a firetruck? It looks more like a regular truck, as it is carrying logs.
That's firewood. All firefighters are secretly pyros. Or they are fire hoses. Notice how uneven they are :)
it is a fire truck. I can probably publish the sidecam footage where it's better seen as such.
see the steering wheel icon to the bottom right, when the background is blue, the car is on autopilot, when it's gray, the driver is in full control.
@@greentheonly I see. Did not even notice that small patch. That is very thoughtful.
Those are folded up firehoses, ya loghead!
@@2nd3rd1st doh, I should've known that. I just assumed they were stored on the sides in cabinets or on some kind of reel
How to distinguish traffic light ?
@Price McTavish If it's red, stop. If it's green, you go. If it's amber, you determine if you have enough time to come to a safe stop. If you do, you stop.
Is this some sort of hack?
What would happen when you would print the back of the firetruck on a big poster and start walking with this board? Would it think you are a firetruck :P?
In certain circumstances yes, if the car "sees" you straight from your back, and you have a real size cardboard truck profile behind you. But if it sees you from an angle it will understand you are not a truck but just a funny human.
Scanning in search of John Connor.
What about signals
Why differentiate between car and minivan?
Just for IC picture display at present.
Autopilot tells the truth: it classifies all the crossovers as minivans. LoL
My friends : hey what are you doing
Me: watching how an Tesla is following a fire truck
Also me: Wait I have friends ?
Forgive me for my ignorance, do you have a write up on techniques used to achieve arbitrary unsigned code execution? Can I do this to my Tesla?
I don't have a writeup, but tencent has some in their past two reports.
Unsigned code execution is easy on infotainment (unless you have a 3 or MCU2, then it's a bit complicated) and quite a bit more involved on the autopilot unit (but still possible)
Pretty cool to see an equivalent of the development version - I'm impressed that you guys pulled this off. Have you considered working with Tesla?
It would be interesting to see what it looks like with the newest version of the NN. If we are to trust Elon's verdict, the new FSD hardware probably won't make a significant difference for a few months, as far as the NN is concerned - except the FPS would obviously be much higher. Looking forward to any further content you can release from your rooted Tesla!
It's not just higher FPS. They have a whole separate branch of software in the works for FSD. The FPS measurements were just to give a baseline of running existing EAP on nvidia you get X, if you ran it on the new chip you get Y frames. They will definitely blow past the nvidia capabilities for FSD and I'd bet money you can't enable FSD without the new computer.
@@jameslporter We agree that FSD will not be enabled without the new computer, as Tesla has officially stated that people who bought FSD will have to switch to the new computer in 2-3 Elon months once their software and NN is superior enough to no longer be supported on the 2.5 hardware. But I was referring to running the current software version on FSD hardware, which I think would primarily be frame rate increases.
I would speculate similarly about their separate branch of software for the FSD computer as Tesla loves vertical integration and dedicated software, but I have no direct evidence. Do you?
Is this not normal?
I wonder how it works at night
It actually works pretty well. you can see my other videos on my channel for examples
Are you the guy that impressed Elon with your analysis recently?
Yes he is!
that was a shared project with three participants. I am one of them.
This new esp is so cool
Its calling every single SUV a minivan
Nailed it
Effectively the same thing I guess
nope lol
They might as well be the same thing. They’re both big cars that mommies like.
It doesn’t have an SUV setting, because it doesn’t need one
How did you get access to this view?
He has root-access to the car, i.e. hacked into it. Also as far as I understand, this view doesn't come from Tesla directly, but greentheonly (and others?) wrote the software to render raw numbers coming in onto a video like this.
@@DerKatzeSonne cool thanks I'd like that view but I know it's not so easy
2:06 Interesting how long the car was detected as "in the right lane"
А светофоры?
damm nice wall hacks
How to setup?
that's the $15k question, I guess.
greentheonly spicy
This is just what I wanted it to look like
Interesting. Seemed quite robust for such a rare truck but a momentary partial occlusion made it completely forget about the large stationary truck.
Cars in opposite direction were not robust though.
Btw is there a single frame offset in the classification? seems there is a slight lag.
there's a bit of offset, yes. Plus detections on the cam are different than framerate and when you compound that with how 36fps is translated to 30fps by framedropping it's compounding the issue some.
Good thing Elon is on record to say this functionality comes to all cars, though, so everybody would be able to generate footage like that. Eventually. May be. ;)
@@greentheonly is there a fixed classification framerate? 15 fps?
18 fps on forward cams, 9 fps on side cams
@@greentheonly thanks for the work. Very insightful. Should be very interesting to see the next feature release. Might just be traffic lights.
To do complete autonomy it would have to see everything basically. A football, a road block, large pothole, flooding, ramps. Toddler on a trike. Seems a ways away.
traffic lights already work since 19.8.x, did not you see my video demo of it?
What firmware version is running in the video?
19.12
Even saying this feels bad... Description!
I actually forgot to add it initially so when the question was asked I added it to the description as well.
Looks like a hit-box mechanism in an fps
Do you have fsd?
no. Nobody has FSD, it just does not exist yet. But I did not pa for the option if that's your question.
@@greentheonly GoFundMe for that option. Heck, you'd probably have enough interest with people only putting in a couple bucks each.
but what's the point? My car is a lease that runs out in under a year. If there's some material FSD change in that timeframe without hw update - I'll make something up then. Right now there's no need to worry about it at all.
greentheonly then how you have stoplight braking
it's an undocumented EAP feature at this time.
Imagine a flooded driveway with crazy drivers and car chashes all over the place? The A.i would must go crazy
This looks like a scene from Terminator.
Can this set can be fix it on my PC game. It will be more easy.
“Who is following me”
Terminator is loading...
😮 wow ❕
"I, too, like to live dangerously"
All these people who are calling this as aimbot should be banned from all game portals. Cheaters...
This is the future welcome!
My computer can even barely run Roblox.
Hey that's how my CoD looks like!
It looks like Detroit become human android scanner
Shit, Tesla will start the revolution
This looks like the car has aimbot
Terminator eyes
This is what human thought looks like your brain does all this calculation automatically.
It looks like the Terminator would see 😣
It is impressive, but there didn't seem to be any recognition of the stop lights or signs, so which software version is this? I'm given a warning if I'm about to run a red light, so clearly the NN recognizes them.
The recognition is there, just have not bothered to fully decipher how it shows and adding icons. There are not going to be bounding boxes because they do it as entire picture properties instead.
The view of a robot :v