Real Time Sign Language Detection with Tensorflow Object Detection and Python | Deep Learning SSD
HTML-код
- Опубликовано: 4 ноя 2020
- Language barriers are very much still a real thing.
We can take baby steps to help close that.
Speech to text and translators have made it a heap easier.
But what about for those that maybe don't speak or can't hear?
What about them?
Well...you can begin to use Tensorflow Object Detection and Python to help close that gap. And in this video, you'll learn how to take the first steps to doing just that! In this video, you'll learn how to build an end-to-end custom object detection model that allows you to translate sign language in real time.
In this video you’ll learn how to:
1. Collect images for deep learning using your webcam and OpenCV
2. Label images for sign language detection using LabelImg
3. Setup Tensorflow Object Detection pipeline configuration
4. Use transfer learning to train a deep learning model
5. Detect sign language in real time using OpenCV
Get the training template here: github.com/nicknochnack/RealT...
Other Links Mentioned in the Video
Face Mask Detection Video: • Real Time Face Mask De...
LabelImg: github.com/tzutalin/labelImg
Installing the Tensorflow Object Detection API: tensorflow-object-detection-a...
Oh, and don't forget to connect with me!
LinkedIn: / nicholasrenotte
Facebook: / nickrenotte
GitHub: github.com/nicknochnack
Happy coding!
Nick
P.s. Let me know how you go and drop a comment if you need a hand! Наука
For those who came here after seeing the Indian girl's post, yeah Priyanjali Gupta plagiarised this repo 😂
😂😂 exactly here for that
Exactly, am just arriving from threads
can i get a link please
But she has mentioned that she used his tutorial for making this model. I think she was just trying it out.
The most logical and understandable guide on the subject I have seen. Great job.
Thanks so much for your kind words @Alan 🙏!
You are my Prof in python. Thank you so much for all, the codes you share, the video and the tutorial you gave to us. 👍
dude. you. are. sick.
thank you man. keep pushing. you could really become something big. super high quality content.
cheers
Thanks so much @Sam 🙏!
Awesome tutorial. I am really glad that I found you!
I was looking for helpful vids on my project and this guy already did my project. Nice
Ayyyeee, glad you found it @David!
How do i contact you?
hey @davidskopalik9073 did you do this project i am facing some issue could you help me out i'll be grateful if you could
@@aankitaaa i mean it has been years not even sure if i have the files but i can try what's your issue
Can you please help me in executing the same project?
This is really impressive! Can't wait to try it out.
Just in time, I'm developing a project for my master's degree about this topic, thanks for the content
hey did you do this ?? i am facing some issuues could ou help me out?
this guy is awesome, hope to work with you one day Nicholas
Oh thanks so much man!! ✌🏽
Nick - Love your channel - Thanks for this video. I was still struggling after the "face mask" video. This one clarified a lot of the important points. It gave me a much better understanding of what is going on than just watching the first object detection video twice... ok ten times ;-) . Speed of training - I have an AMD RX 580 video card instead of NVidia so I'm stuck with training via my AMD 3700X CPU (or am I?). No hindrance to the learning experience of course, but if I had only known last year when I built up my systems... sigh. Thanks again, you are truly a terrific teacher!
Ohhhhhh I know the pain of getting the GPU to work. Yep, unfortunately at the moment only NVIDIA cards seem to dominate the deep learning space. I think there's work being done on the AMD cards but it's still a while away. SOOOOO pumped you got it all working though!!
@@NicholasRenotte Your videos are among the scarce few worth watching, so yeah!
Nick, you are amazing! All thanks to you for making a well organised video with soo much clarity 💥💥 .... I did my first deep learning project based on your teaching and safe to say that it was a HIT among my professors.... I look forward to make more of such projects... Thank you so much Prof. Nick .... You are the BEST⭐⭐⭐⭐⭐
@yonipaul6077 how did you train the model with tensorflow 2x??
I'm loving the contents of this channel!
Thank you so much @Zaheer!
Dear Nich Sir, I was a software engineer student, yesterday my results has come out and I got a first-class honor for my BSc degree, For the final project, I got 80 marks. My final project was Sign language detection in my language (Sinhala language). That project was kinda Advanced, but your sign language detection videos series inspired me to make a better project for my finals. So Thank you soo much and wanna say this, again and again, YOU ARE THE BEST AI TEACHER IN RUclips, Keep making these kinda videos and make others' life brighter like this. I think you should pin this comment. ⭐⭐⭐
This is amazing news!! Congratulations!!!
@@NicholasRenotte Thank you Sir
@@irugal8964 hey how did you do it? I'm not able to use tensorflow. I'm error version error. What should I do? Please please help me🥺
@@sukanyadessai6238 ruclips.net/video/dZh_ps8gKgs/видео.html this is the video i followed and setup all correctly. Also for the data training i hv used colab.
hey i'm working on same project and got few errors can u help to solve it
Wouaouhhhhh... Man, your amazing :) ...
This is what I was searching for after some months of Machine Learing study
🙏🙏🙏 thanks so much, glad you enjoyed it!
@@NicholasRenotte No, thanks to you with your awesome works, awesome technics, ...But could you make a video on how to save this model ? ( Save the mobel in tflite format, tf.js format for example?)
@@nyharenafitahiantsoaraheri3557 definitely, it's coming in the next couple of videos!!
@@NicholasRenotte Ouuuupiiiii ,,, can't wait to those videos :)
@@NicholasRenotte I have already test an object Detection project in flutter application that uses the SSD mobilenet and YOLO and if I am not wrong I think by changing just the .tflite model and the label.txt by this one, I think it will work because I think your model extends to SSD mobilenet
Excellent explanation... Thanks for sharing!
Dear Nicholas, I would first like to thank you for showing us these amazing tutorials, they are nothing short of educational and fun. I came here asking for help though, if it is ok with you. I am developing a similar project to yours where the Object detector would figure out which technique in Judo it is observing. I am trying to run the project and I followed the tutorial to a T. I am able to train the model, but the loss value always starts at NaN (technically I am not able to train the model, but step 6 is within reach, because I can execute the command). I have gone through the comments and have done all the suggestions, which include:
1. Double checking the labels
2. Decrease the learning rate (although that is only viable if the loss value does not start at NaN)
3. Used 2 different datasets (1st is the Judo dataset, the other is the image dataset that was created, the same as yours).
4. Followed the installation to everything on your previous videos (Tensorflow installation + CUDA/CUDNN and Face mask detection tutorial)
It would be greatly appreciated if you do end up helping me. But if not, this is still a very interesting video.
same issue bro if get the solution please tell me
I finally completed this project
Thanks Nick for your wonderful explanation
and super simple guide lines 👍
Amazing video
YESSSS! Amazing work @Ishmeet!
@IshmeetAhuja Can your help for this project. I got error during running the tutorial code.
@@shubhamnagalwade4642 can you tell exactly which step
@@ishmeetahuja9343 I got error during config file. When I run code config_util.get_configs_from_pipeline_file(CONFIG_PATH)
Error is:- Message type "object_detectio.protos.TrainConfig"
@@shubhamnagalwade4642 hmm, that's the full error? Sounds like the protoc step might not ahve been run during installation. Can you try running through this: ruclips.net/video/dZh_ps8gKgs/видео.html
Hey one girl has copied your code 😂 she is getting more fame than this video literally she is 😂😂😂😂😂😂😂😂😂😂😂
Chutt bhai
Ikr 😂
Really good explanation.. and real time experience is awesome.. thank a lot.. 👏
is it working model ?
Thank you so much for this wonderful tutorial
Can you help in solving the error no module named object_detection in creating tf record
This tutorial is great. Love the explanation
So glad you enjoyed it @Dan Jay!
How do you not have more views? This is amazing content!
We're getting there @Joseph! Either way, a tonnnn more videos coming! I've got 285 tutorials left on my list to do (and it keeps growing each week) 🤣!
Hello @NicholasRenotte Sir, Thanks for the amazing tutorial! I am glad that I found this savior tutorial last minute....Thankyou so much :)
Good stuff dude. I'm and embedded software guy trying to learn some of this stuff to control my TV with sign language. Haha
Hahahah, that's awesome, shoot me a vid once you get it working! That'd be sickkk!
Finally a video that makes sense !!!
🤣 Oh I know where you're coming from, it was a nightmare coming up with the walkthrough for this. The content and documentation is haphazard as hell. I just need to make an installation video now!
@@NicholasRenotte True
Haha I bet it was laborious, by far thought this the best video in RUclips that implements some sort of tracking hand gesture that makes sense all the way through lol
@@ypm7369 thanks so much 🙏 , it honestly means a lot you saying that!! I'm working on how to export the models and work with them in Tensorflow.JS apps right now...there's also sooo little documentation for how to do it properly.
@@basics7930 better documentation anyone 😅?! #amirite?
This is amazing
Great content....Really helped me with one of the projects I was working on
Keep making videos like these
Plenty more coming @Rohil, sooo glad you enjoyed it!
@@NicholasRenotte please help me
Hi Nick great fan of your work. Can you do a video on temporal action localisation on an untrimmed videos. I saw a lot of interest in that topic in the industry. But there are a very few repos and blogs about that. The repos that are out there doesn't cover many things in detail.
This will help a lot of people and get good attention.
thx u so much for taking this tutorial video.
I just done my program from packages installation to real-time detection.
but the I think i need to change another cnn/rcnn model and train it again.
because my accuracy is wired lol.
Anytime!! How long did you train for? It really varies, one of the other peeps on the channel was saying it took them 2000 steps but it might take longer.
Hey y'all! Wrote up a couple of steps to setup your environment. I'm planning on doing a video on this but until then, here's a crash course post:
1. First up install Python 3.7.4. Download and install the package for your OS that has the words 2019.07 in it from here repo.anaconda.com/archive/. This should give you 3.7.4 to work with.
2. Then install Visual Studio C++ 2015 from here: go.microsoft.com/fwlink/?LinkId=691126. Tensorflow needs this in order to compile
3. OPTIONAL IF YOU HAVE A GPU - Install Cuda and Cudnn. Install Cuda first, then install Cudnn.
- Cuda: 10.1 - developer.nvidia.com/cuda-10.1-download-archive-base
- Cudnn: 7.6.5 - developer.nvidia.com/rdp/cudnn-download
Once Cudnn is installed you need to copy the Cudnn files into their respective folders inside the Cuda directory. I used this as a guide: towardsdatascience.com/installing-tensorflow-with-cuda-cudnn-and-gpu-support-on-windows-10-60693e46e781
4. Then install Protoc 3.13 from here: github.com/protocolbuffers/protobuf/releases. For windows, download the repository and then add it to your PATH file.
5. Then install python packages using the pip command:
Tensorflow: 2.3.1 - pip install tensorflow==2.3.1
OpenCV: 4.4.0 - pip install tensorflow==4.4.0
6. Install the object detection API. To do this, run these commands from a command prompt or terminal:
git clone github.com/tensorflow/models
cd tensorflow/models/research
protoc object_detection/protos/*.proto --python_out=.
cp object_detection/packages/tf2/setup.py .
python -m pip install .
I have followed all these steps ..but still i am getting error as object _detection module not found...
What should i do.. Please help me out here!!
@@rashmigaikwad1116 Same here. Did you manage to solve it?
OpenCV: 4.4.0 - pip install tensorflow==4.4.0 (is this a Typo do you mean pip install opencv-python )? at step 5!
will this work with later versions of python?
Thanks for this amazing tutorial Nick. You explained everything so nicely.
A quick question, if I trained this model previously for 20 pictures of each class, and now I wish to increase the training dataset to around 50 pics. Will I have to retrain the model from scratch? (Cause on CPU, it took me around 5 hours to train for 20k steps!)
You don't have to but you need to tweak your code if you want to pick up from where you left off. If so, you need to freeze your model, export it, then update your pipeline.config file to pick up training from that checkpoint (fine_tune_checkpoint parameter in the pipeline.config file!)
@@NicholasRenotte Hi! Is there a way where I can see an example of this? We are trying to train an Hebrew Sign Language model thanks to your video :)
Hi I am also training the model on cpu since I don't have GPU. And 2500 steps were done in 2 hours! So should I continue or stop because my pc has become super slow...will it be ok to leave the pc overnight?
Your videos are so encouraging... 🙌🙌🙌
Nicholas! I have solved all errors. Although it was not easy, all codes worked well . Thank you so much for upload this tutorial!
THIS IS AMAZINGGG to hear! Thanks so much for powering through! Deployment to RPi next?
Im having an error with cv2.imwrite. any tips? thank you
@@simonconneely1615 got some errors for me?
can you help me please
This is lit 🔥 - keep it coming!
Oh you know it! A tonnn more stuff coming in this space @Tenzin!
Hi I'm glad I found your video! First of all, You are awesome man! Keep it up!
I'm planning to do a similar project as a research proposal for a graduate school application and I was wondering how can I train my model if the sign language uses hand movements rather than still poses.
Heya Jan, you can use a slightly different architecture to do it! I've been researching it lately and it looks like there's already a model out there that handles it, check out Tiny Video Net: tfhub.dev/google/tiny_video_net/mobile_1/1
Hi iam also searching sign language research topic urs dun research topic
That was really well explained, thank you. What I'm confused about is how do you make a Pass/Fail object detection system?
I can see how you'd spot say a normal widget on a conveyor belt, but how would you detect a broken widget, or a misplaced cat on the conveyor belt?
I was looking for helpful vids on my project ,I would like to know how this project is different from other existing ones and how we can improve when compared to the other projects. Thanks
Hi Nicolas, finally I have been able to run everything. Although my recognition is not that accurate . I guess it would be nice to automate the part of selecting the gesture in every picture 🤣
Oh, that's part of the fun!! Here's some stuff you can do to boost your accuracy:
1. Train for longer
2. Add more images (possibly some with different backgrounds and clothes)
3. Add images with varying poses and levels of blur or distortion!
For some reason, my code isnt running. Can you share the complete code I have a look
Well installing the object detection api messed up. Can you please help me
Great video. Appreciate your effort a lot! Two questions: If you would perform two gestures using both hands at the same time, would the model have detected both gestures at the same time? Is it possible to train for one class only? Best regards
Hi Raphael, in this case it would as I labelled images for each class using both hands. If I only used one hand per class e.g. right for hello, left for no, right for yes and trained for a while. Then there's an increased likelihood that it would only detect the class that matches the hand.
@@apnadekhtu How are you goin to train the model? For this the best is to use any dns to your routher like Open Dns Family Shield. Sorry for my poor english
Thanks for the tutorials. Really helps and they are amazing! Wanted to ask you what when you want to run it without having to use the commands at jupyter notebook. Like, just a normal app or computer program? Can you help me with that step?
How did you manage your time, both for you full-time tech job ( that might be overtime ), youtube project, and your life activities. Love your channel ❤
Hi Nicholas. Thank you for this amazing video! How long did it take you to train this model? I'm going to train a model for detection about 10-15 gestures, but I also want to make train dataset for each gesture slightly bigger. If you remember the approximate amount of time I think I can roughly estimate how long the training session will take for me.
I am doing the same thing, can you help me with this? please. That'd be very nice if you offer to help me.
@@tejeswanisenapathi2708 hello, did you do it?
Thank you so much for this tutorial Nicholas ! One more thing I wanted to ask that is it possible to read out the phrases that gets recognized by the system? If yes, please do guide !
Planned!
you can use a tts library for python
@@JamilKhan-hk1wl Hey. I'm halfway through the project. Can you pls tell me how many nodes are being used in this Project? And about activation function, if possible. I would really appreciate your reply.
could you include the audio output in your project? if yes then can you tell me how you did it?
i really apreciate your help with dowloanding this software
Very useful video. Thankyou so much .
Thanks for this amazing tutorial. I used it to train a model exactly as you did. Do you know what the best way to load the model I have trained into the C++ API of tensorflow? Thank you again!
Could try loading the checkpoints that were saved to C++. In theory it should work, although haven't try it out yet man.
Can you help me in solving the error no module named object_detection in crete tf
Hello Nicholas, I know you made this project long ago, but still I would really be glad if you let know what are the algorithms used here. Can we use other algorithms to this for its better accuracy and results like KNN, logistic regression or decision tree, if yes, please guide how. And last, how to generate the classification report here. Please help as I`m really new even to Python language as I have been seasoned with JAVA by far.
Nicholas, thank you, that's a 100% subscribe! May i ask you a little question, please? I know that optimal number of num_steps parameter depends on the task and on the model. Is there a way to implement early stopping in TFOD to get rid of this hyperparameter? Thank you so much, mate!
Hello from Italy!
Thank you so much for this amazing video. I have one question. Can we add voice 'Hello' along with text 'Hello' in real-time detection?
If yes please guide me. Thank you again.
Are you awesome. Greetings from Colombia.
Thanks so much @Juliam, what's happening from Sydney!
Thank you so much for this content, you saved me with my senior project- which is ASL alphabet recognition (turns out MATLAB is terrible for someone new to this field)... however, how can we implement this style detector for letters like "j" and "z" which require movement? I have seen many papers about combining lstm's with cnn's but it seems like everyone is keeping their cards close to their chest and their are no actual good tutorials on this matter... what are the chances of you doing one of these within the next month or so lol?
MICK JAGGER! Yah, definitely it's on the cards. I don't know if it'll be out within the next month but I've already got action detection down in the next set of tutorials!
had a great learning though i got a lots of errors in the way but that make me go deep into subject and taking this from scratch is awesome and again expectinga a lot like these from your side nick
How did you train the model with tensorflow 2x?
@@rajasrithiruvarasan3164 same ques bro.......having alots of error
Hello Nicolas. I'm a fan of your channel, and I wanted to congratulate you for the video. Could you adapt this code to recognize water drops or do you think that another video of yours would be better adaptable? Thanks.
Hi Nicholas. Thank you. Do you also have the final model that you trained with your images? I'd like to convert it to tflite and try it.
Heya @Luca, I don't have it saved anymore unfortunately. I've got this one available but it only detects hello (not trained for that long though): github.com/nicknochnack/TFODRPi/blob/main/detect.tflite
thank you for this great video .I just have one question. this code just recognize every sign that we give to it. if we want to have a code with all sign to recognize every sentences and words , what should we do?
You have to train your model to detect the signs that you want. So, you could add in all of the additional words you'd like to have recognized as part of your image collection and labelling @samaneh.
Amazing Nicholas, love all your videos. Had similar project in Matlab, but loved your python-tensorflow version the best...Amazing keep up the amazing video and content work!!!!
Can you help in solving the error no module named object_detection in creating tf record
great JOB man, I'd like to thank you it's very nice video
Excuse me, I want to ask. At 11:01 minutes, in the program to take pictures automatically, my program has no errors at all, looks good. The camera is detected successfully, the frame appears, and the frame can display the image from the camera. After the program finishes (camera off) a new directory appears, but none of the images are saved. What happened? May I know the explanation? Thank you before!
Thank you so much, sir! I wonder what if I train about 100 different signs and gestures? Should I alter the layers in that config file? How to deal with overfitting and underfitting problem?
Heya @Nigar, all you need to do is ensure you have examples of all 100 signs and gestures as part of your images, update your labelmap so you have them listed and change your number of classes to 100 in the config.
Salam Nigar. I am from Azerbaijan. Are you also doing the project for Azerbaijani sign language? If so, could you please contact me for cooperation in some points? I am doing the project.
Hi Nicho! Great tuto as usual. I wonder if it's possible to use videos instead of images for training because I noticed that many signs requires a sort of movement? Thanks in advance.
The video will be divided into many photos for training based on the frame rate, they are the same
Nick sir...this session was really helpful.. keep on rocking with coding🎉
How did you train your model with tensorflow 2x?
Please, solve me, SyntaxError: invalid syntax how to ?
Hello Nicholas, I hope you’re doing well❤️
I would like to thank you for your video that helped us alot💘. Now I’m actually in the training step, I tried to train the model in my laptop “which doesn’t have a GPU “ so it took 10 hours to train 20 photos. Is there a way or a device that I can buy that will make the training process faster in my laptop?
Heyyyy, can you please help me with my project. I'm stuck at this place. If you could help me please.
Heya @Haifa, you can try using an external GPU (eGPU) but these tend to be a little more expensive then just getting a basic gaming computer with a half decent GPU.
Definitely, what's up @Anaa?
@@NicholasRenotte heyy, thankyou so much for the reply, here is my error
Traceback (most recent call last):
File "Tensorflow/scripts/generate_tfrecord.py", line 29, in
from object_detection.utils import dataset_util, label_map_util
ModuleNotFoundError: No module named 'object_detection'
Traceback (most recent call last):
File "Tensorflow/scripts/generate_tfrecord.py", line 29, in
from object_detection.utils import dataset_util, label_map_util
ModuleNotFoundError: No module named 'object_detection'
@@anaashaikh7342 this looks like the OD API hasn't been fully installed. Try running through this first: ruclips.net/video/dZh_ps8gKgs/видео.html
Hey, I'm so thankful for all the help you have given me. Thankyou so much.
I am done with step 6 with the training part.
When I ran the 7th step, I got this error:
---------------------------------------------------------------------------
NameError Traceback (most recent call last)
in
1 # Load pipeline config and build a detection model
----> 2 configs = config_util.get_configs_from_pipeline_file(CONFIG_PATH)
3 detection_model = model_builder.build(model_config=configs['model'], is_training=False)
4
5 # Restore checkpoint
NameError: name 'config_util' is not defined
What do I do?? Please let me know. I need help.
awesome!!!!! too happy to learn
What version of python, tensorflow and opencv are you using?
Heya, just updated the pinned post, all the install steps are there! These are the versions and source locations:
Python: 3.7.4 -
Windows: repo.anaconda.com/archive/Anaconda3-2019.07-Windows-x86_64.exe
Mac: repo.anaconda.com/archive/Anaconda3-2019.07-MacOSX-x86_64.sh
Linux: repo.anaconda.com/archive/Anaconda3-2019.07-Linux-x86_64.sh
Tensorflow: 2.3.1 - pip install tensorflow==2.3.1
OpenCV: 4.4.0 - pip install tensorflow==4.4.0
Protoc 3.13 - github.com/protocolbuffers/protobuf/releases.
If using GPU
- Cuda: 10.1 - developer.nvidia.com/cuda-10.1-download-archive-base
- Cudnn: 7.6.5 - developer.nvidia.com/rdp/cudnn-download
in step 5 someone gave this error? 96 callable (pipeline_config_path)
97 with tf.io.gfile.GFile (pipeline_config_path, "r") as f:
98 proto_str = f.read ()
TypeError: 'module' object is not callable
Have you completed and executed this code? Because there are certain errors that I am getting and I need some help
Hey!! Mr, can you make video on how to Deploy object detection model online, plz😇.. And love your content as always🤗🤗
Here you go ruclips.net/video/2dwSXXMFhPY/видео.html 🙂
@@NicholasRenotte Is there name length limit for object in detection model?
like in label [ ] ,'I Love You'..
if not then we can have labels like 'Hello How are you there.'
@@DhruvPatel-mg6ou I don't believe so, I think you should be fine to include longer labels!
@@NicholasRenotte thank you for the reply..
Frame (Not responding)
???
Awesome tutorial!
Amazing work Nicholas
Thanks so much @JohnDoe!
Thank You so much for explaining the project code by code. I am facing a small issue. My TF records are not getting created. Do you have any idea why? I've gone through many videos of yours to understand where am I going wrong.
hey have u got solution for this?i'm getting same issue
@@prathi.editss I am stuck on the same issue.Do you know its solution now?
hey, were you able to solve it? I'm stuck on the same issue
Hey Nicholas, in my first run I trained my model to 12000 steps. There is still a relatively high loss (0.25). How can I alter the training command to retrain starting from my latest checkpoint?
Same here
Heya, try changing your checkpoint in your config, point the line below to the folder where your new checkpoints are located:
pipeline_config.train_config.fine_tune_checkpoint = PRETRAINED_MODEL_PATH+'/ssd_mobilenet_v2_fpnlite_320x320_coco17_tpu-8/checkpoint/ckpt-0'
Should be something like, change it to the appropriate checkpoint number based on what you've got. Then rerun the same training command.
pipeline_config.train_config.fine_tune_checkpoint = CHECKPOINT_PATH +'ckpt-6'
Woo awosm handy i am learning deep learning todY w8sh me luck bro i will try
Absolute YES!
Who are here after that LinkedIn post ? 😂
mee :D
me too...lol
haha 🤣
@@MohanSinng vit full form?
😂😂
Hey! Thank you for this amazing tutorial, I'm trying to create a video conferencing project and want to include this as a feature, can you please guide me on how I can do that?
Haven't dug into integration with VC tools that much unfortunately @Sunidhi.
hey Sunidhi, I am also working on the same project. Could we discuss?
@@dhivyarooparavi1108 Hey Yuktaa! Yes sure, pls let me know how I can get in touch with you!
Hi there, were are making an android application for a graduation project and I'm wondering how to link this API to our code in android studio? in the end, I'm really glad that I found your video! thanks a lot ❤️!
Heya @Haifa, you can export the model to Tensorflow Lite and use it in an Android app!
Hey there! I have issue with this "2. Create TF records" step. I am trying to run this and it is processing from a very long time without any output. Is there something I need to do ?
Heya @Amrutha, are there any errors? How many images are you processing?
@@NicholasRenotte Heyy. Thanks for replying. I am processing around 1000 images . The error is stated as follows "AttributeError: module 'tensorflow' has no attribute 'gfile'". (version of tensorflow is 2.3.1)
@@amruthashetty3546 if you run pip list is tensorflow AND tensorflow-gpu 2.3.1?
@@NicholasRenotte Hii . I resolved the earlier issue . Now there's a new error "Message type "object_detection.protos.TrainConfig" has no field named "fine_tune_checkpoint_version"." and yeah if I print config, there is no such field.
@@NicholasRenotte I also have this issue. pip list shows I'm running version 2.4.1
Bro some girl has copied ur code and she is getting more fame than u.. I also came on ur video after seeing her video..
What a great video!
only after i started working on this that i realise how much effort it for this 30min video
hey i am facing some issues could you please help me
@@aankitaaa sure,i will try to help, what are the issues
[Errno 2] No such file or directory: 'Tensorflow/workspace/annotations\\label_map.pbtxt'
I'm getting this error, can someone help me? (doing this on Collab, MacOS 10.15.3)
Heya @Siddaharth, try removing one of the slashes after annotations and flipping the other so you have:
Tensorflow/workspace/annotations/label_map.pbtxt'
@@NicholasRenotte
Would it matter if I did this in Collab instead of regular Jupyter notebook?
I'm getting another error when doing it in Collab.. (I've already installed object-detection through pip)
Traceback (most recent call last):
File "/content/generate_tfrecord.py", line 29, in
from object_detection.utils import dataset_util, label_map_util
ModuleNotFoundError: No module named 'object_detection'
I'm really sorry for bothering you with this, I just am really thankful for your videos and time!
I'm always here to help, no stress@@sid4752. It should be relatively similar, that error is because the object detection API hasn't been installed, try running through the install video: ruclips.net/video/dZh_ps8gKgs/видео.html
VIT wale full credit lekr marketing kr rhe. koi to roko unhe 😂
i was wondering why that girl is getting so famous 😂
exactlyyyy
Hi - it sounds really exciting, I wondering if the model needs to be retrained to detect movement with a new person. I missed what type of information the model is using to make the detection so I am not so sure how much generalizable it would to different people with different hand/upper limb size, skin color or objects wore on the hand (ring, wristband, watch...).
Really like your smile, Nicholas👍
Sir, when i capture the images they are not showing in the collectedimage folder. Please help
Same problem!
Normally this is because the file path isn't fully defined. Do you have a folder called collectedimages (I think that's what I called it in the vid).
@@NicholasRenotte i did everything same, all label folders are created inside collectedimages but there's no image in there.
Please help sir!
Hi Nicholas! Thank you so much!
I got this, please help:
error: OpenCV(4.4.0) /tmp/pip-req-build-dglzv4yn/opencv/modules/imgcodecs/src/loadsave.cpp:738: error: (-215:Assertion failed) !_img.empty() in function 'imwrite'
Heya @Nigar, at what part of the code is this occuring? :)
@@NicholasRenotte I got the same error for the line cv2.imwrite(imgname,frame) (code shown in 8:58 of the video)
How do we resolve this error?
@@tumtum6910 heya, let's check a few things 😁.
1. What do you get if you print frame before the cv2.imwrite line
2. Is your webcam activating?
maybe could try to check for the "cap.release", it needs to be at outside the for loop
you are a life saver, your video has put an end to my search on how to train my model on terminal instead of notebook. But my question is how can i plot the lost graph if i train my model in terminal
Check this out, when using the training steps provided it will automatically generate the logs for you. You just need to point tensorboard to them using the command tensorboard --logdir='path to train checkpoints' (tensorflow-object-detection-api-tutorial.readthedocs.io/en/latest/training.html#monitor-training-job-progress-using-tensorboard)
@@NicholasRenotte thanks
@@OkorieEmmanuel anytime, let me know if you need a hand.
it's working thank you soo much for your information
Anytime! Thanks for sticking through it @Suresh!
Hey, I'm working on this project and need some help urgently. Can you please please help me out.
Hi nicholas. Thank you for the amazing tutorial!!
Im facing a tiny problem and I need help. When I run the cell
'config = config_util.get_configs_from_pipeline_file(CONFIG_PATH)'
I get the following error: 'module tensorflow has no attribute gfile'
I tried replacing every tf.gfile in the config_util with tf.io.gfile and it still doesn't work.
How can I fix this please?
Heya @Shaimaa, this looks like a tensorflow install version issue. I'm releasing a setup video from scratch tomorrow which should solve it all!
@@NicholasRenotte Thank you so much! I'll be waiting for it
Its out got for it :) - ruclips.net/video/dZh_ps8gKgs/видео.html
@@NicholasRenotte Much appreciated, keep up the awesome work!
@@shaimaahossam1306 anytime, will do!!!
ValueError : 'images' must have either 3 or 4 dimensions
Why :/
In the comment below, you wrote that rerun cap.release (). But I tried it and it didn't work. I use colab :/
Pls help🤦🏻♀️
Ah, you can't capture the images using colab. It's not able to access your webcam through the notebook. Try capturing the images locally and then training on colab if you need to!
@@NicholasRenotte i already have a test train. Education etc. everything ok. I came to the end. The last code have such an error. Detection-opencv part. If I do it locally I have to go back to the beginning : /
@@meryy.3779 awesome, ah you don't, you just need to bring your checkpoints over to your pc and run it from there. There is a way to access your webcam from colab it just takes a little more work.
Super useful!
Thankyou so much for these tutorials Sir! Lovin your channel!❤️
Quick question: Can this be used to convert the detected sign language to text in real time?
Best Regards!
Sure can!
Can you help in solving the error no module named object_detection in creating tf record
Bro I am facing some issue can you hel me
@@SriHari-xu6zz have you solved this problem, i got the same problem
Hi Nicholas! Love your videos. I had a quick question, how do I tweak this to create a model that can recognize from a preloaded dataset? Should I just add the dataset in the images folder? And can I use video dataset for the same.
Yup, just throw the images into the folder. For video, gotta split it out into frames and label them!
Can you help in solving the error no module named object_detection in creating tf record
nice thank you for the tutorial
Hello Nick, I had a question regarding the last step where you ran it and it opened the camera and showed the detections. Is there a way to record which object is being detected and then do something if a specific object is detected (eg. print hello to the console if it detects hello, or print yes to the console if it detects yes)?
Definitely, I actually show how to do something similar in the Automatic Number Plate Detection tutorial. It shows how to add a logic gate as part of the detections!
Hello Nicholas, first of all thanks a lot for this amazing tutorial. I wanna ask you that, Can I label the images in Bengali?
Incredible man. Loved it. Btw, what version of OpenCV did you use?
Oh I can't remember now and I just reinstalled my Python env, my bad man.
@@NicholasRenotte No problem man. I used 4.5.3 version and implemented your video successfully. Thanks a lot !
Thank you so much!
Hey. I'm halfway through the project. Can you pls tell me how many nodes are being used in this Project? And about activation function, if possible. I would really appreciate your reply. Thanks in advance
Had u faced this error?
Cannot import "string_int_label_map_pb2" from "object_detection.protos"
Hello Nic, I'm very glad to find your tutorial video, I try to follow your code and I've already clone your git repo. But I don't find label_map file in my annotation clone folder. can you help me how to find this file? Thanks for your attention. God bless you sir
Hi Nicholas,
I had a question, how do you convert our trained model to tensorflow lite to be used on microcontroller.
Awesome mate