So basically this is what you need: -- A drone. Basically any drone that has a pixhawk or similar flight controller that runs ardupilot wil work. But if you are building from scratch you could build something like this: - Get 10 inch drone propellors and motors (t-motor is one of the best brands). A motor between 400 and 1000kv should work fine. - 30a Esc’s. Any brand is fine but t-motor or hobby King make good ones. - 4s lipo battery. 3s is possible but 4s will increase flight time a lot and also give the drone more power for faster following. Tattu makes good batteries. - flight controller that can run ardupilot and is released after the pixhawk. The chineese clones of the pixhawk can be really bad sometimes. A more expensive unit but which I really like a lot is the cube orange. Otherwise a radio link pixhawk is also good. I would recommend buying a flight controller in a kit. This will make sure that you get everything you need like wires, speaker, safety button, telemetry system etc. - gps + compass module. Get a radio link module if you are on a budget or a Sirius f9p from dronetek. Don’t buy a cheap unit. Gps and compass is one of the most important sensors for a drone. Getting a cheap one will result in crashes! - for the frame a dji f450 or tarot clone of this frame is good. Going with quad motors is the easiest and cheapest. -- beside a basic drone we also need some specific parts. These are: - jetson nano 4gb module. (Dont buy the 2gb model it is not good) - a 1080p csi camera. I like modules with the imx219 sensor a lot. Easiest would be to just buy that one. - a step down converter like the LM2596 I used. - a tf Luna LiDAR module from benewake. - a 3d printer to print some custom brackets located on GitHub. - adding a usb wifi module to the jetson will enable remote debugging of the system using ssh. Definitely recommend this. That would be it! Good luck trying to make it. Definitely send me a video if you have it flying.
@@sieuweelferink6852Hey, where I live the pixhawk and similallars are out of stock. Do you think I would be able to crete something like that with a beta flight FC? I know they are more focused for racing but I wonder if I could create an autonomos drone like that. It is a FC Omnibus Betaflight F4 PRO V2 Flight Controller STM32 F405
@@sieuweelferink6852 Hey buddy Even I am working on the similar project using ML in it. Can you suggest me the best controller in the Pixhawk exactly so that I can get the documentation and really use it. And also I want to add the sensors to it like air pressure sensors etc. Is there a provision to add those sensor and if it is possible then which sensors are available in the market for it. your Guidance will be Valuable
@@sieuweelferink6852 Hi, I'm trying to create a drone that avoid incoming objects using AI. Can you explain implementing AI features into a drone a little bit further. What components should I use to achieve that ?
Oh man, this is genus. I watched another video on a similar project using the Jetson and it wasn't even close to as smooth as this solution. Very elegant, and it's python!
Very nice E46 man I really like it it's a coupe, I have the sedan (4 doors) 330i, I'm an embedded system engineer I do some PCB design for IoT devices, I'm also a ROS enthusiast actually I was watching some videos on PX4 MavROS and I found your video. Keep up the good work bro you are amazing I really people like you
I will try as much as possible! But my projects are complicated and thus will take time. I will now focus 100% on the autonomous vehicle V2.0. So stay tuned for that!
That's impressive, congrats. Slight little nitpick your flight computer is not the Pixhawk, that's your flight Controller, and your flight Computer is the Jetson. Just a good thing to know for people starting in UAV development.
what if instead of jetson nano I transfer this information ground station (laptop) and perform algorithms and command back to my drone. Is it possible??
Thanks for sharing..nice project. I need your help. I want my drone fully controlled by the raspberry pi for landing pad detection and auto landing on the designated landing pad..all controlled by raspberry pi via mavlink..could you help on the mavlink code?
Great job This is something which is very useful in industries.I have been planning to build like one of these for autonomous tracking. Could you please suggest me the PC configuration required to run a yolo model at 30FPS for custom object. Thanks in advance
@@sieuweelferink6852 how do you make the image run on 25fps i tried everything (im a beginer) and the best i got is i open image and than close it and repeat and its slow,garbage,stuppid,annoying.any sugestions?
Why did you connect lidar to jetson nano but not to PX 4? In this case, it would be possible to connect the Jetson to the Pixhawk via a serial port. And you don't need a USB to Serial converter. Data from the lidar can be obtained using the Mavlink protocol
Great work and solution! Carry on, and you could have a great future, by doing this as your future job! On question, if possible. Do you think it could be possible to integrate a library of objects the drone has to track and follow? For example Cars,, Bikes, People or equal, or is therefore AI needed? I mean something same like the Autel Evo Max is offering?
Yes definitely. The model I used is trained on the imagenet dataset. So basically the drone could track every object which is in this dataset. I think there are over 50 different objects. I just simply filter for only the object type person. But changing that line to a list will enable what you want.
Nice work. A little over engineered 😅. I had a follow me function in my drone 10 years ago. It wasn't based on AI obviously. My phone, that's always in my pocket, sends its GPS data to the drone as a new destination and tadaa, drone is coming 😂
Hello Sieuwe, it is a great work. I have the M690L hexacopter from Align. It is a bit older one, so i intend to use an additional hardware/software to update the AI possibility of this drone. Is this O.K. that you could check what is possible with genuine flight Controller of this copter?(APS M). Is there a way to contact you (PN)?
Hi @sieuweelferink6852, I love what you've done here. I'm aiming for a similar project which includes a net launcher for a final year engineering project. I've run into a dead end trying to develop an autonomous drone under a betaflight system. The plan now is to flash ardupilot to my existing SpeedyBee F405 V4 and pretty much run your code. However, I want to offload the processing to a ground station PC and not use a Jetson. Could you provide any tips to make this work seamlessly? The idea is to have identical functionality to your system, but tracking drones not people, and having a pc process the tracking and following code.
Hi so it is really easy. First build a drone with a pixhawk flight controller. Just search online on how to do it. Then mount a jetson nano and rgb and tf luna lidar on the drone. Install all software on the jetson nano and run main Python program.
hI! im interested in using your crowd analytics project as a foundation in a project me and my classmates are currently trying to develop. is there any way i can contact you if we have questions? emails or discord calls?
Thanks for the video. I am really interested and i want your guidance in making a full drone if you don't bringing your help forth, I would I appreciate
Hey beginner here. Dumb questions if anyone doesn't mind answering. Is a Pi Pico, MicroPython, and Flight Controllers like Pixhawk PX4 essentially provide the same function in combination with an NVIDIA Jetson? In other words, NVIDIA can be programmed to run Python image recognition programs such as OpenCV. Then a flight controller, Pi Pico, or MicroPythob can be used to send commands to a drone or any bot for that matter. In combination both can be used say to provide image recognition and send commands to the bot using the image recognition outputs. Am I understanding this correctly? Also, if the above is correct, does that mean that one or the other is the main board i.e. Pi Pico runs the commands, but receives the instructions from the NVIDIA Jetson?
Thanks for sharing. Can you also post the hardwares/materials to build this drone including the sensors and everything? Thanks.
So basically this is what you need:
-- A drone. Basically any drone that has a pixhawk or similar flight controller that runs ardupilot wil work. But if you are building from scratch you could build something like this:
- Get 10 inch drone propellors and motors (t-motor is one of the best brands). A motor between 400 and 1000kv should work fine.
- 30a Esc’s. Any brand is fine but t-motor or hobby King make good ones.
- 4s lipo battery. 3s is possible but 4s will increase flight time a lot and also give the drone more power for faster following. Tattu makes good batteries.
- flight controller that can run ardupilot and is released after the pixhawk. The chineese clones of the pixhawk can be really bad sometimes. A more expensive unit but which I really like a lot is the cube orange. Otherwise a radio link pixhawk is also good. I would recommend buying a flight controller in a kit. This will make sure that you get everything you need like wires, speaker, safety button, telemetry system etc.
- gps + compass module. Get a radio link module if you are on a budget or a Sirius f9p from dronetek. Don’t buy a cheap unit. Gps and compass is one of the most important sensors for a drone. Getting a cheap one will result in crashes!
- for the frame a dji f450 or tarot clone of this frame is good. Going with quad motors is the easiest and cheapest.
-- beside a basic drone we also need some specific parts. These are:
- jetson nano 4gb module. (Dont buy the 2gb model it is not good)
- a 1080p csi camera. I like modules with the imx219 sensor a lot. Easiest would be to just buy that one.
- a step down converter like the LM2596 I used.
- a tf Luna LiDAR module from benewake.
- a 3d printer to print some custom brackets located on GitHub.
- adding a usb wifi module to the jetson will enable remote debugging of the system using ssh. Definitely recommend this.
That would be it! Good luck trying to make it. Definitely send me a video if you have it flying.
@@sieuweelferink6852Hey, where I live the pixhawk and similallars are out of stock. Do you think I would be able to crete something like that with a beta flight FC? I know they are more focused for racing but I wonder if I could create an autonomos drone like that. It is a FC Omnibus Betaflight F4 PRO V2 Flight Controller STM32 F405
@@sieuweelferink6852 Hey buddy Even I am working on the similar project using ML in it. Can you suggest me the best controller in the Pixhawk exactly so that I can get the documentation and really use it. And also I want to add the sensors to it like air pressure sensors etc. Is there a provision to add those sensor and if it is possible then which sensors are available in the market for it. your Guidance will be Valuable
@@sieuweelferink6852 Hi, I'm trying to create a drone that avoid incoming objects using AI. Can you explain implementing AI features into a drone a little bit further. What components should I use to achieve that ?
He is a type of guy I am searching my whole life to be friends with.
suprisingly, robots hunting people down scares most people
This is the kind of youtube channels WE want to be recommended to 🙏.
I have subscribed
True
Thank for sharing this and the breaking it all down! I have been wanting to make my own from scratch as well and make it fully autonomous!
Oh man, this is genus. I watched another video on a similar project using the Jetson and it wasn't even close to as smooth as this solution. Very elegant, and it's python!
Nicely done! Don't give up sharing your content. Even if there are similar projects out there.
YOU ARE OVERPOWERED!!!
Very nice E46 man I really like it it's a coupe, I have the sedan (4 doors) 330i, I'm an embedded system engineer I do some PCB design for IoT devices, I'm also a ROS enthusiast actually I was watching some videos on PX4 MavROS and I found your video.
Keep up the good work bro you are amazing I really people like you
How hard would it be to switch from tracking mode to a "kill mode"? Where drone will collide with tracked target at full speed.
Very cool, this is great stuff man. Keep it up and thanks for sharing.
Really good work man!
opened my eyes to a pretty cool hobby my dude thanks :D
This is brilliant work !! Well done!
That was fantastic man . Please upload more❤️
I will try as much as possible! But my projects are complicated and thus will take time. I will now focus 100% on the autonomous vehicle V2.0. So stay tuned for that!
@@sieuweelferink6852 great man. good luck.
What happened with this project? Did you stop working on it?@@sieuweelferink6852
Looking forward to this!!
Thats awesome bro, you have new subcriber here
great work. thanks for sharing. do upload more of your work. you are such an inspiration for drone developer.
Keep it up bro, well done.
Couldn't you use the bounding box size instead of lidar?
Brilliant video, inspirational!
That's impressive, congrats.
Slight little nitpick your flight computer is not the Pixhawk, that's your flight Controller, and your flight Computer is the Jetson. Just a good thing to know for people starting in UAV development.
Great job buddy, learned a lot🙏🏼🙏🏼🙏🏼
Great project man!! I just wanted to know how the drone behaves when there's more then one person in its view or when there's none. Thank you
Great job! Could u please refer to the sensor models? which rgb camera and lidar did u use?
Hi. Where did you connect the Lidar to? To Jetson? Thanks
Thanks for sharing. Could you post a new line follower drone using pixhawk?
a line on wall with arrow direction to move up down left right n yaw to go behind the wall
I wish no one will come and buy you out becos we need you in these forums :)) !!
what if instead of jetson nano I transfer this information ground station (laptop) and perform algorithms and command back to my drone. Is it possible??
Thanks for sharing..nice project. I need your help. I want my drone fully controlled by the raspberry pi for landing pad detection and auto landing on the designated landing pad..all controlled by raspberry pi via mavlink..could you help on the mavlink code?
Thank you🙏
You're really a good kind and helpful young man👍
Cheers🕊️
wow you re crazy, keep going!!!!
Can i do this project without a lidar sensor and by using a raspberrypi5
Now way!
You should make a home security drone. That would be awesome!
Thanks for the video 🤙
That’s a really good idea! He should do that.
Great project! Thanks for sharing with us
Is it even possible to simultaneously implement the mav condition yaw (for yaw) and mav frame body ned (for forward)?
which library is used for drone control? it doesnt seem that you have used drone kit
thanks for sharing, this is so wonderful
Good Job Sieuwe
Thanks for the support!
i had Deja Vu @6:58😱it felt like i already watched that part of the video🤯
Amazing work
Great job This is something which is very useful in industries.I have been planning to build like one of these for autonomous tracking.
Could you please suggest me the PC configuration required to run a yolo model at 30FPS for custom object.
Thanks in advance
Jetson nano 4gb is fine for tiny yolo model. Otherwise look at jetson Xavier. Can run at a couple 100 fps!
@@sieuweelferink6852 how do you make the image run on 25fps i tried everything (im a beginer) and the best i got is i open image and than close it and repeat and its slow,garbage,stuppid,annoying.any sugestions?
Awesome project!
Can we control pitch yaw and roll without using pid control in program?
Need to see it follow you versus other people in the same area.
why do you need the lidar assuming you can get the distance based of the a bounding box size?
Are there any cheaper alternative for jetson nano board
Why did you connect lidar to jetson nano but not to PX 4? In this case, it would be possible to connect the Jetson to the Pixhawk via a serial port. And you don't need a USB to Serial converter. Data from the lidar can be obtained using the Mavlink protocol
Did he connect the lidar to Jetson?
Amazing. You are genius.
Great work and solution! Carry on, and you could have a great future, by doing this as your future job!
On question, if possible. Do you think it could be possible to integrate a library of objects the drone has to track and follow? For example Cars,, Bikes, People or equal, or is therefore AI needed? I mean something same like the Autel Evo Max is offering?
Yes definitely. The model I used is trained on the imagenet dataset. So basically the drone could track every object which is in this dataset. I think there are over 50 different objects. I just simply filter for only the object type person. But changing that line to a list will enable what you want.
hi my drone need to detect a box and pick it up its similar to ur project can u help me out
Sick! May I ask: are the camera and lydar directly connected to the jetson and not the flight controller in any ways?
Sieuwe you are great person ❤✌👋
How were you able to calibrate both rotations and forward movement for the right PID control?
Is it possible to complete the task with more cheap flight controller?
Any updates on that obstacle avoidance?
Thank you for using 3s. My favorite battery size. :)
Really nice . Thank you.
nice project, when is your part 2 coming, (autonomus obstacle avoidance drone) ?
Bro, can i use raspberry pi 5 instead of jetson nano?
This is too cool, thank you for making it open source
Great man! What about HOME position update in INAV, or any other soft. to actual transmitter position, when transmitter is moving?
I would like to see two or more drones follow the same target in synch with each other.
Just amazing
Great job but you need more recognition 👏👏👏👏👏
Thank you for watching!
Can you please confirm that this will work on a PX4 stack as well .
can i get the link to part 2 please
I need your help regarding autonomous flying drone without gps pls help n reply
Nice work. A little over engineered 😅. I had a follow me function in my drone 10 years ago. It wasn't based on AI obviously. My phone, that's always in my pocket, sends its GPS data to the drone as a new destination and tadaa, drone is coming 😂
Hello Sieuwe, it is a great work. I have the M690L hexacopter from Align. It is a bit older one, so i intend to use an additional hardware/software to update the AI possibility of this drone. Is this O.K. that you could check what is possible with genuine flight Controller of this copter?(APS M). Is there a way to contact you (PN)?
Thanks for sharing
Thank you very much for your efforts.
Thank you for watching!
please i want the schematic diagram
Jij bent echt n held
Oh yes, that what i need😍
I was literally looking for this exact thing for delivering packages to my friends in my neighborhood
Hi @sieuweelferink6852, I love what you've done here. I'm aiming for a similar project which includes a net launcher for a final year engineering project. I've run into a dead end trying to develop an autonomous drone under a betaflight system. The plan now is to flash ardupilot to my existing SpeedyBee F405 V4 and pretty much run your code. However, I want to offload the processing to a ground station PC and not use a Jetson. Could you provide any tips to make this work seamlessly? The idea is to have identical functionality to your system, but tracking drones not people, and having a pc process the tracking and following code.
I think you need rtmp to get the video feed from drone and apply the object detection to detect person and then use the tracking code
Amazing 👏👏👏
so cool. thanks
nice job man...
hello "kuya siuwe" im from philippines what youre callage you learne?
hi! are you still working on this? part 2?
Nice work man need to try this my self. Can you make tutorial fron no drone to fully automated drone. Building and programming
Hi so it is really easy. First build a drone with a pixhawk flight controller. Just search online on how to do it. Then mount a jetson nano and rgb and tf luna lidar on the drone. Install all software on the jetson nano and run main Python program.
@@sieuweelferink6852 thank you so much you are very helpful
Thank you!
Where to get the same drone?
Can you please make a project on gps and navigation UGVs for agriculture!🙏
Great thanks 👍
hello bro i need help
Wow 👌
please keep uploading
Bro can you make a complete AI powered fpv drone building from scratch it would be alot of helpful for me please bro I want that so badly
are you still using the PS4 Stereo camera?
Can this code run on a raspberry pi?
love it
hI! im interested in using your crowd analytics project as a foundation in a project me and my classmates are currently trying to develop. is there any way i can contact you if we have questions? emails or discord calls?
Hi you can just ask your questions here so everyone can use the information i give you!
Thanks for the video. I am really interested and i want your guidance in making a full drone if you don't bringing your help forth, I would I appreciate
Hi Sir,
This is very great project!!
May i know the spec of motor you’re using in this project?. It is very much appreciated
Hello, I'm going to do something like this. Is it possible to get in touch?
Hey beginner here. Dumb questions if anyone doesn't mind answering. Is a Pi Pico, MicroPython, and Flight Controllers like Pixhawk PX4 essentially provide the same function in combination with an NVIDIA Jetson?
In other words, NVIDIA can be programmed to run Python image recognition programs such as OpenCV. Then a flight controller, Pi Pico, or MicroPythob can be used to send commands to a drone or any bot for that matter. In combination both can be used say to provide image recognition and send commands to the bot using the image recognition outputs. Am I understanding this correctly?
Also, if the above is correct, does that mean that one or the other is the main board i.e. Pi Pico runs the commands, but receives the instructions from the NVIDIA Jetson?
Uber Cool.
You should post a full tutorial