Navigate on openpilot vol2 - comma three full drive
HTML-код
- Опубликовано: 7 сен 2024
- trying out the newest nav model from openpilot! pls subscribe, and sorry for the weird audio! will get a better mic for the future. edit: nav model is officially in master!
--
FREQUENTLY ASKED QUESTIONS
- What fork/branch is this!?!?
[Branch] master
- What car do you drive?
2021 Hyundai Sonata Limited
- What camera(s) do you use?
If the video is fixed in the frame, I am using a GoPro Hero9 mounted on my sunroof. If the video appears to be handheld, it's my iPhone 13 Pro.
- Do you recommend openpilot?
If you 1) like the idea of L2 autonomous driving, 2) drive a "gold" vehicle, and 3) have the monetary means to purchase a comma three, then yes!
- How can I contribute?
With ideas! If you have any ideas on what content I should create, feel free to comment it! You can also support me by buying me a coffee! www.buymeacoff...
#openpilot
I really appreciate the videos you make with the Comma 3. I'm mainly interested in the development of the navigate on openpilot feature, and you're literally the only person that makes full in-depth real-world example videos of how far along it is. I think by the time version 1.0 finally hits, this'll be a very impressive little piece of tech, all things considered.
Edit: Not sure what your area is like, but trying out navigate on openpilot on rural roads would be interesting. Especially doing turns.
That’s because navigate on openpilot has never worked and hasn’t got any better at all since it was introduced. It’s embarrassing to show all the fails most of us don’t use it at all
Hey, I just wanted to thank you for putting these videos out there. I just bought a '21 Sonata Limited today and placed my order for the 3X and harness bundle. I appreciate the way you tell the OpenPilot story, and I'm looking forward to getting back into it after 3-1/2 years. Thanks again!
No matter how clunky and experimental it is, the fact that we are now seeing NOOP videos like Tesla FSD betas is AWESOME!! I am glad I have my C3 in my Palisade. I love to show people how this tech works NOT in a Tesla!
Exactly, I'd love to buy it. Especially because it's open source code and I can modify it. This way I can replicate their systems and make a small machine that would autimatically navigate around towns
Thank you for making this! Besides giving a good view of where comma is today, it will be super valuable to have these videos to look back to in a year or two to see how things are progressing.
On the system itself, it really seems to me that this is a year or two behind Tesla FSD (sorry, I can't help but compare :-)). It's still super good to have the multiple approaches competing, in addition to the car makers that have their own systems, and Cruze/Waymo. Who knows - maybe Comma will be able to catch up to Tesla and close the gap. Super exciting to watch this happen in our lifetimes!
I could not agree more with you, my main goal with these videos are so that we can look back later in the future and see the progression that openpilot has made. openpilot is definitely behind FSD beta, Tesla has the fleet+hardware advantage, and has more engineers, while comma's smaller team needs to develop a system that can work with many different manufacturers. Regardless, I too cannot express just how exciting it is to see the power of ML and self-driving unfold right before our eyes!
It’s awesome that there is an inexpensive, open source retrofit option like this, but to say this is even in the same league as FSD beta is just insane.
definitely not in the same league, but exciting to see a third party solution to crappy first party systems
Yea for sure.. But hold in mind that FSD upgrade on a Tesla does cost around 10x of what this system costs.
Hopefully this pushed us closer to having proper competition to bring those higher prices down.
Hope this evolves to approach Tesla FSD functionality, with high steering torque and excellent longitudinal velocity control. Maintaining the open source aspect will be a really great advantage over Tesla FSD.
I believe steering torque is a limitation of the specific vehicle not the device. Tesla doesnt have this problem since they control the complete vehicle and software.
@@ccibinelComma has certainly modified firmware of some vehicles in order to give Openpilot the desired level of steering torque, such as on Honda vehicles for example. Gets trickly when safety and reliability is involved, of course. Again, open source can help out a lot here, for good evolution over time.
So strange seeing you drive around my neighborhood. I live close to Rio Hondo Elementary. I have an Ioniq 5 and highly considering purchasing openpilot and I'm guessing I'll have pretty similar experience as you since I'm assuming our cars have the same ADAS. Your videos have been very helpful, thanks. Looking forward to more videos.
haha it's a small world, i live nearby so I'm sure we've probably passed each other at some point! The Ioniq 5 is quite capable with openpilot, should be better if not on par with the Sonata. You can always purchase a comma three, and return within 30 days if you don't like it! (although I'd maybe wait a little because it seems like comma might release a version with a red panda sometime in the near future, eliminating the need for a can-fd kit). And thank you, I really appreciate it! Excited to make more videos on openpilot!
@@jacyy what does the can_fd kit do?
I’ve come to the conclusion that when you accelerate instead of letting it accelerate, you will almost always have a harder time turning because you’re messing up its plan. Atleast that’s how it works in my head
I just got done with a drive with Sunny Haibins latest iteration of Sunnypilot. The experimental driving model is soooooooooo much better now. I barely touched the gas on the way home dude!!!
Great video, can't wait to buy one and try it out for myself
I am so happy to see an open source ADAS. I would absolutely not trust this thing as of yet, but I also wouldn't trust Tesla FSD. It's incredible how advanced this is.
8 months ago you did this in a Hyundai. I just ordered the new 3x for my Honda. Curious to know how it will handle a manual transmission... Let's find out!
Are the problems with tight turns hardware limitations, i.e. the car manufacturer doesn't allow the steering wheel to move quickly enough, or can they be fixed in the future?
A little bit of both. Steering torque is always limited by the LKAS messages that the manufacturers set in place. For Hyundai/Kia/Genesis cars, the LKAS EPS torque is actually quite high, more so on CAN-FD cars, but openpilot does not currently use all of it. Panda limits the steering torque to 3Nm (this Sonata can supposedly exceed that), based on comma's testing, so that the wheel cannot randomly jerk. There were some talks about low-speed torque (blog.comma.ai/taco-bell/#ev6-blinkers-and-low-speed-torque), but there hasn't really been more work on it yet (I think they're prioritizing better driving models at the moment), but in theory there's more room for improvement here. This of course changes with different cars/brands.
@@jacyy thanks for the reply. That makes me hopeful. Probably a good choice to play it safe with the torque for now
I'm running Sunnypilot and it seems that the driving too slow in experimental mode has been fixed. A few weeks ago I actually got an entire drive in my Acura that was hands off which is a surprise with the steering torque limitations. Hasn't happened since but I enjoyed it nonetheless
2:27 - I would have slammed the brakes. The car did not stopm
is there a fork that visualizes stop signs on the UI and displays other debug?
steering torque limit will always be an issue
Have you done videos on the hardware and software install processes? What videos would you recommend? Thanks.
It doesn't have a back camera though right?, so how does it do a lot of things
BSM that some cars have. (Side radars.) It's not a perfect system, the driver still must be attentive.
Do you have auto lane change disabled? On mine whenever it starts going for a turn I turn on the signal to let other people know and it attempts a lane change (since I already inadvertently "nudging" the wheel to help with the torque).
I don't see any lane change messages while you turn on signals for the turns tho.
I wonder if it wears out the steering torque related system over years of use when normally without self driving the torque in the steering wheel would be used very little. Possibly getting weaker years later. Just curious. I just ordered one, ships in 1 to 8 weeks. You waited 2 days for the windshield mount to cure? Very excited. I'm going to possibly start with openpilot then try opgm branch made for Chevy Bolt. 2023
That has been questioned a lot, but the simple answer is no. The steering system is already electrically powered and outputs higher torque when you’re manually steering the wheel. openpilot uses existing lane-keep messages from the manufacturer, which typically is a lot lower than what the motor is rated for. I waited 24hours after mounting for the VHB to cure, following the VHB curing guide by 3M. Higher ambient temperatures can reduce curing time!
If it moves, it wears. The question is does it wear out? It shouldn’t wear out any faster than manual steering. Try turning your wheels with the vehicle off. You will notice how difficult it is to turn your wheels. That will show you that the electric power steering is doing all of the work when you manually steer you’re more or less telling the power steering motor which direction to turn the wheels. When you turn your vehicle on and notice how easy the steering is, you’ll be convinced that you are not assisting the power steering in any meaningful way.
You could argue that the open pilot moves your steering wheel less. From what I’ve noticed people make more minor adjustments to stay in the lane than OP does. It would probably take five years or so to inspect the wear and tear of a vehicle driven manually vs OP as much as possible. If the OP vehicle had less wear and tear, I wouldn’t be surprised.
Do you happen to know Which harness is for the phev Tucson version?
man this thing is needing a looot of help. i think most of it is steering torque issues and the curbs. other than that looks solid but in cities i think ill just manually drive.
Even Tesla's FSD isn't magic around city streets. These automated driving assistants are really helpful for long road trips and for the most part just a toy feature elsewhere.
I have a comma 3 on my 2020 camry hybrid. any idea if theres a branch or fork i can download to be able to get longitudinal abilities? thanks
Yea I also have a 2018 camry
Better than a teen driver
I so wish my 23 chevy bolt EUV worked on experimental mode. my option is grey'd out (something about using the stock GM acc i believe it says) maybe the next update though. I absolutely love what it does offer for now though.
Works on my 2022 Bolt EUV. After the newest update on 6/18.
I switched to the sunny pilot fork and that has done the trick.
Just bought an Ioniq 5 and am interested in this technology. Like some of the commentors, it doesn't look like it is ready for prime time yet for side streets and that is what experimental is all about. How does it work on the highways which is where it will most likely used the most?
On highways, openpilot can drive pretty much without a disengagement. City streets are challenging atm because it involves knowing how to accelerate/brake depending on its surroundings, whereas on the highway, it just needs to follow a lead car if there is one. openpilot makes road tripping on highways extremely easy, and supersedes Hyundai’s system.
@@jacyyjust bought the 2024 Mazda cx90 phev and every year we drive from San Francisco to Las Vegas. Just drove the car there last month, after owning it for 2 weeks. I used radar cruise control pretty much the entire way to there and back. If my car has land centering, it would make the long drive so much easier. I am definitely getting the comma 3 for freeway driving. I'm very impressed! Wish there a version to have this work using the stock screen, but I'm sure that will be an option the future.
@@jacyy is it significantly better than the system that Hyundai already has?
I have a 2023 nline hundai Sonata and bought the simcard and paying the monthly fee for comma prime. Its saying that my car doesnt support experimental mode because of the ACC. How do i get this to work with my car or did i waste my money on this? I bought the comma 3 fyi.
It’s definitely supported, however, there are 2 prerequisites to using experimental mode on Hyundais. 1) need to be running a master-based branch (master-ci ideally, cannot use release3), and 2) toggle on openpilot longitudinal control (Alpha) first, then enable experimental mode after.
Join the Discord! Lots of people who can help you get going.
Can you tell me which Scopes to use if I am using mapox
Has open pilot improved since making this video? I have the same car and I'm thinking about buying the comma 3
Models have continued to improve, but overall, I'd say it's still about ~90% the same. Waiting for the day a dramatic model change comes along. Regardless, the C3 was still one of the best products I've purchased to date.
does it take note of other cars at the stop sign?
Your comma3 doesn’t look centered. Maybe that’s why your car is always biased to one side of the road.
It’s centered! The camera housing in the car is actually off-centered
Great video! Were you in ACC mode when the video started?
The entire video was shot with Experimental Mode enabled. (required for navigate on openpilot).
Any thoughts on how this compares to stock lane centering systems? For it to work on a lot of fords you already have to have the highest feature set when it comes to lane centering and all that. My ford has that on the highway but I’d never trust it in the city. Is this enough of an improvement over ACC + Lane Centering to justify the price?
little late but, it does outperform most stock systems. Something to keep in mind when thinking about capabilities is that openpilot is completely e2e, which means it knows how to drive without explicit rules. For example, stock systems need lane lines, while openpilot will use its best judgement based on what it sees and what it’s been trained on to drive without needing lane lines. I can’t really give you a clear yes/no answer, because everyone’s experience is different. What I would suggest you do is purchase a device, and return within 30 days if you’re not satisfied. comma has a fantastic no questions asked return policy to let you try openpilot out.
How do you capture the screen in the lower right corner?
Please let me know if you have a website that would be helpful.
I used openpilot’s replay tool to record, but a simpler way is just to use this tool: github.com/nelsonjchen/op-replay-clipper
It does require a bit of setup though. If that’s too challenging, I believe you can use Replicate (read the README), but it will be paid.
Amazing video! You got me convinced. What does “gold” car mean? Is 2019 Hyundai Sonata compatible with full open pilot? It states it on commaAI to be fully compatible
Old terminology, thanks for reminding me to update it! As long as your 2019 Sonata has SCC (adaptive cruise), it should be supported with openpilot! It doesn't look like it supports experimental mode though, but you should definitely join the Discord and ask around there.
Curious how you mount your camera for recording? I can never get rid of the constant vibrations in my recordings
Mounted onto the sunroof! I use a GoPro because it’s lightweight, and have digital stabilization disabled on the camera. I do all of the stabilization in final cut. Without it, the footage is a little shaky
I've never driven openpilot like this. I didn't even know it was capable, and haven't even downloaded the app. (But I do have the monthly subscription.) Interesting!
(I have tried experimental mode, but I also found it's iffy as you've pointed out.)
is the subscription plan need for auto pilot?
Very sad that does not work on my toyota venza 2021
Does navigate on OP require a subscription or something or is that base functionality?
It’s open source code, so if you’re willing to figure it out; it’s free. Otherwise, you need to subscribe to comma prime ($16/mo for lite (BYO SIM), $24/mo for full).
Just a curious question: Is the factory AEB functional when the openpilot ACC is on?
On the Sonata, no, unfortunately factory AEB needs to be disabled when op ACC is on.
Thanks for the reply. No AEB is a pity.@@jacyy
Can you tell me if you are using your phone as a hotspot to get data for the comma three? Are you required you to purcase any type of of data data plan?
T-Mobile has a great plan for data only, $10/mo for 30GB of high speed data, and 256Kbps unlimited thereafter. I pay for this + comma prime lite ($10).
You don’t really need to purchase any data, but I do it because it allows me to take snapshots pics while the car is parked and I’m away
@@jacyy Thanks very much for your response. What is the device in your passenger side of the window just to the right of the camera cover? Does it have anything to do with Openpilot?
Just a standalone dashcam that I installed, has nothing to do with the car nor openpilot!
so does the hyundai sonata have the full steering torque to make right turns or does it not? I heard that it can if you use a specific fork of openpilot but Im not sure. Could you please let me know?
So the answer to this is a bit complicated. Some of the issues in the video are more model issues, where the turn planning is not quite there yet; but at the same time, low speed torque can be improved on the Sonata. You can read more into this in comma’s taco run: blog.comma.ai/taco-bell/#ev6-blinkers-and-low-speed-torque
@@jacyy thank you so much for answering, and you did it so quickly! Thanks for letting me know, have a great night!
@@jacyydo you modify about torque code?coz my steering turn too early…I’m not sure does it model issue?
@@s70160 No I don’t touch the code involving steering. I think the issue with turning too early might just be a model problem. But I’m not too sure.
Looks decent! What fork/branch are you using?
Install this branch and it should just work!: github.com/commaai/openpilot/tree/enable-nav-features
@@jacyy this no longer exist.
@@MrKenstea It's merged into master!
@@jacyy so, ready for 0.9.3?
@@jacyycan you post url to install for all us newbies PLEASE. I want to unleash my c3s full potential
Every time you drive it you are training it. Allowing it to overrun stop signs is reinforcing its training to do so
That's not how openpilot training works, fortunately. comma only trains on disengaged driving data, and even then, I don't believe that's how comma's training process works
how do you mount your camera?
Is it trying to do all that with the one comma camera and built in radar?
In experimental mode, openpilot uses the two front facing cameras on the comma three (wide/narrow cams). It doesn't use radar!
Nice video~~
Do u use stock openpilot or a fork? Do u need the monthly subscription to use the navigate on autopilot?
I primarily use stock openpilot. The code is open source, so if you can figure it out, you can use navigate on openpilot for free. Otherwise, you need to subscribe to comma prime to get access to navigate on openpilot!
@@jacyy I'm not paying the 25 a month to subscribe . Can't find a benefit for the navigate part yet
It's it not free for two months?
@@jeffbeckley8899 if u have a new device u get a one month trial for free
What camera and mount do you use?
GoPro Hero 9 mounted to my pano roof!
Is it a total self drive system?
Or semi-selfdrive?
L2 system, so it’s not 100% full self driving
How much does this cost? I have the exact same car
I believe it’s $1,299+tax including the harness!
how does around pedestrians ?
hit or miss at the moment
pun intended? 🤣@@jacyy
Where can I buy an open pilot?
Software is free! You can use openpilot on a comma 3x for $1,250: comma.ai
openpilot (no space) is the software. comma 3x is the hardware.
Not what I was expecting, It seems to perform very poorly.
man open pilot is super behind compared to to tesla... I wonder if they will even be viable n the future when other car manufacturers catch to tesla and have lvl 2 drive aide
This did not inspire me to buy this thing. It seems ok. Not great. Not yet ready. Maybe a few more years.
Experimental for a reason; not ready for prime time. Main selling point for a comma three is to use it for chill driving w/ standard op long, especially with highway driving. Anything beyond that is considered experimental and not guaranteed to work well, more of a “wow” factor. Also need to remember that openpilot needs to work in conjunction with the limitations of stock ADAS systems.
@@jacyy I have 2019 Prius hybrid. With lane assist and cruise distance. For 2000$ I want to just plug it in and drive away without too much hassle. It seems like it could work well. Just not quite there yet
@@jacyy If you had to guess, how many more years until experimental becomes default?
@@rachelkarengreen99 Hmm honestly, I don't think I could accurately guess. I don't think comma wants to take this out of experimental mode until they've really got everything nailed down. We're still at the early stages of their e2e long planner, and as depicted in the video, there are still a lot of improvements to be made. But don't get me wrong, it's exciting to see all the progress, I would've never thought any of this would be attainable years ago. That being said, comma is working on their ML simulator twitter.com/comma_ai/status/1666959310310752257, which should help them improve their training and bring improvements to their end users.
@@user-xk4qv6lh5k Depends what you intend to use it for and how much you drive. If you do a lot of highway driving, this will surely be worthwhile. If you want it to drive you everywhere, well, may need to temper your expectations at the moment.
Tesla's FSD is way superior
how much fsd cost again?
Comma is still crap. It is a lost cause as a self drive company
How are you setting the destination? Don't you need to set that on the comma?
On my phone using the comma connect website. You can only select cached destinations or favorited destinations on the device
@@jacyy Is that part of the comma Prime subscription thing? Or free?