Thanks for the time you invested to let us know about this cool Model. but one question, I have material pieces in size of 1 to 4 mm, mix of plastics and copper, wood, glass and etc. is it possible with SAM label them also or its just masking? I need to label them and create different classes for them.
Hi, it is Peter from the video! I know that SAM was accessible for free in RF for some time. I'm honestly not sure if that is still the case. Please let me ask around and come back to you.
@@yannsieyadjeu good question. Take a look at this tweet: twitter.com/braddwyer/status/1646953843790434314?s=46&t=PmKZyPs_J7tyW5sS8kHeLg top right corner of editor.
Hi 👋🏻 It is Peter from the video. That functionality is the right now :) That was one of my recommendations to dev team after making that vid too… and now it is there. You can run conversion with one click :)
Amazing new upgrade please i am having problem to upload my trained yolov8x instance segmentation mode to roboflow using api it works for object detection models but not for instance segmentation
Hi Sir I'm Beginner in I saw your Computer vision video's its fully combined and merged can you please update one by one video order that time we can understand easily thank you.
This is awesome! Will there be an implementation in the future to have an auto labeling feature? For example in this case, not even needing to click on the cracks, but the auto labeler knowing to automatically segment the cracks in the image.
Full zero shot annotation? We are experimenting with it… we will crate Google Colab and video tutorial on Tuesday. As for feature in the editor I guess it all depends if it will work good enough. Stay tuned.
I'm on my a free trail and keen to have a go, and my labeling toolbar only has [Drag tool] and [Comment] options, which is different from what you have shown in the video. Is that becase the [Smart polygon] can only being accessed to paid version?
Hi, can we do medical images or x-ray images segmentation using smart polygon..?? Because if we talk about histopathology images than we have to segment very very tiny areas in one single image. Can we do that kind of segmentation using roboflow..??
Hi 👋🏻! It’s Peter from the video. I didn’t show any X-ray example because I didn’t wanted that video to be super long. But sure! I think that automated X-ray image segmentation is possible. Feel free to take a try and annotate some images. You can create account for free and that feature is also free for now.
@@Roboflow If the performance of SAM on COCO detection is validated (for example, use masks and CLIP model to get the class label in COCO categories), perhaps YOLOv8 is not needed at all?
@@yulei7199 depends on what you want to do. In some cases YOLO is not needed. In some cases when speed is primary objective it is better to run YOLO segmentation without SAM.
Any help is appreciated. I downloaded my custom dataset, 1's where I highlighted my object of interest, and zeros everywhere else, but my labeled images are completely black. No regions of images that are white? Is there a tutorial on how to successfully download a custom dataset?
ah I figured it out. For anyone who gets stuck. when you download your custom data set all your objects of interest will be labeled as one (that's if you're just doing one class); therefore, in order to view your labels you need to open up the labeled image using matplotlib. To actually see it you do this: import matplotlib.pyplot as plt import cv2 path_to_label_img = " " image = cv2.imread(path_to_label_img) plt.imshow(image[ : , : , 0])
Is it possible to try out this tool in custom images for testing sam? is it available publically? I'm working on a project that uses SAM and want to test it on some sample images.
Is it possible to set threshold values for area coverage of similar objects in an image and segment them as same class but with different colored masks depending on their size?
Hello Team! I am working something where I need to find size of the object in centimeters/mm. I remember Peter made a similar implementation one of the video but I missed the link of that. I have been scratching my head since past 30 mins. Could you please share the link of that video..🙏🏽🙏🏽
Sure! Here it is: ruclips.net/video/_Zr1pOi7Chw/видео.html starts at 8:04. We will most likely have a dedicated vid for that use case, but that won’t happen in near future so this is all we have.
can SAM do segmentation mask annotation to bounding box or can roboflow add this feature ( like convert all bbox to polygon ) ? please share the collab code or other reference because I have dataset annotated with segmentation and I want convert to bounding box for research with some model , thank you.
If you save the segmentation dataset in COCO format you will get boxes for free and can use it both in object detection and image segmentation scenarios.
@@Roboflow thank you, but why not add features convert ALL smart polygon to bonding box in annotating mode ? 😅 because maybe we can look it for review the annotations again hehe...
Is it possible to set threshold values for area coverage of similar objects in an image and segment them as same class but with different colored masks depending on their size?
![Eminem - Fuel (feat. JID) [Official Lyric Video]](http://i.ytimg.com/vi/t5H_CewqpKA/mqdefault.jpg)
Wow you guys are so fast. Let’s see how long after other labeling tools would add this feature especially those pricey ones.
Good job on implimenting this so quickly. Other applications would have taken weeks.
💪🏼
@@Roboflow excited sir 🙏
thanks for sharing !
Thanks for the time you invested to let us know about this cool Model. but one question, I have material pieces in size of 1 to 4 mm, mix of plastics and copper, wood, glass and etc. is it possible with SAM label them also or its just masking? I need to label them and create different classes for them.
Nice 👍
But why don't you add Grounding DINO directly as button so you can annotate images with boxes using text prompt
I’m dropping Google Colab with that next week. And who knows? If that goes well maybe we will add full auto annotation to Roboflow editor 🔥
Thanks for integration! I couldn't use the semantic masks generation for my dataset and use SAM. Is it not under the free trial?
Hi, it is Peter from the video! I know that SAM was accessible for free in RF for some time. I'm honestly not sure if that is still the case. Please let me ask around and come back to you.
I don't understand why you don't have a button for "convert all bbox"
It was not there when I recorded but it is there now 💜 That was my feedback to. You can convert all with one click.
@@Roboflow Hey fam. Where is the button "convert all"?
@@yannsieyadjeu good question. Take a look at this tweet: twitter.com/braddwyer/status/1646953843790434314?s=46&t=PmKZyPs_J7tyW5sS8kHeLg top right corner of editor.
@@Roboflow Do we have the ability to change all images in a dataset from bboxes to SAM without going through each image manually?
It would be awesome to convert all bounding boxes to polygons without having to right click each object
Hi 👋🏻 It is Peter from the video. That functionality is the right now :) That was one of my recommendations to dev team after making that vid too… and now it is there. You can run conversion with one click :)
Amazing new upgrade
please i am having problem to upload my trained yolov8x instance segmentation mode to roboflow using api
it works for object detection models but not for instance segmentation
Thanks! Are you using our notebook?
Hi Sir I'm Beginner in I saw your Computer vision video's its fully combined and merged can you please update one by one video order that time we can understand easily thank you.
Hi, it is Peter from the video? Do you mean videos related to zero-shot annotations?
This is awesome! Will there be an implementation in the future to have an auto labeling feature? For example in this case, not even needing to click on the cracks, but the auto labeler knowing to automatically segment the cracks in the image.
Full zero shot annotation? We are experimenting with it… we will crate Google Colab and video tutorial on Tuesday. As for feature in the editor I guess it all depends if it will work good enough. Stay tuned.
I'm on my a free trail and keen to have a go, and my labeling toolbar only has [Drag tool] and [Comment] options, which is different from what you have shown in the video. Is that becase the [Smart polygon] can only being accessed to paid version?
Hi, can we do medical images or x-ray images segmentation using smart polygon..??
Because if we talk about histopathology images than we have to segment very very tiny areas in one single image.
Can we do that kind of segmentation using roboflow..??
Hi 👋🏻! It’s Peter from the video. I didn’t show any X-ray example because I didn’t wanted that video to be super long. But sure! I think that automated X-ray image segmentation is possible. Feel free to take a try and annotate some images. You can create account for free and that feature is also free for now.
Is it possible to use SAM to actually detect and count specific objects? (for example, fruits on a tree)
If you just want to do detection and count I'd go with your regular object detector like YOLOv8 for example.
Can I use SAM for object detection with YOLOv8?
SAM is a segmentation model. What you can do is use YOLOv8 for object detection and than convert those boxes into segmentations with SAM.
@@Roboflow If the performance of SAM on COCO detection is validated (for example, use masks and CLIP model to get the class label in COCO categories), perhaps YOLOv8 is not needed at all?
@@yulei7199 depends on what you want to do. In some cases YOLO is not needed. In some cases when speed is primary objective it is better to run YOLO segmentation without SAM.
Any help is appreciated. I downloaded my custom dataset, 1's where I highlighted my object of interest, and zeros everywhere else, but my labeled images are completely black. No regions of images that are white? Is there a tutorial on how to successfully download a custom dataset?
ah I figured it out. For anyone who gets stuck. when you download your custom data set all your objects of interest will be labeled as one (that's if you're just doing one class); therefore, in order to view your labels you need to open up the labeled image using matplotlib. To actually see it you do this:
import matplotlib.pyplot as plt
import cv2
path_to_label_img = " "
image = cv2.imread(path_to_label_img)
plt.imshow(image[ : , : , 0])
Glad you figured it out… I was super busy with latest video. And haven’t noticed that question.
Is it possible to try out this tool in custom images for testing sam? is it available publically? I'm working on a project that uses SAM and want to test it on some sample images.
Is a 2s lag after selecting an object with sam in the roboflow editor still normal?
Can i upload shapely polygon wkt as annotation to roboflow?
Unfortunately not :/
@@Roboflow oh that’s 😞. Coco did support interior either what should i do?
@@aminmemar416 if you can convert it to COCO it would unlock roboflow upload for you
@@Roboflow it is not supports holes either. I want to segment walls and exclude pictures and windows
@@aminmemar416 SAM does not support holes unfortunately:/
Is it possible to set threshold values for area coverage of similar objects in an image and segment them as same class but with different colored masks depending on their size?
Hello Team! I am working something where I need to find size of the object in centimeters/mm. I remember Peter made a similar implementation one of the video but I missed the link of that. I have been scratching my head since past 30 mins. Could you please share the link of that video..🙏🏽🙏🏽
Sure! Here it is: ruclips.net/video/_Zr1pOi7Chw/видео.html starts at 8:04. We will most likely have a dedicated vid for that use case, but that won’t happen in near future so this is all we have.
@@Roboflow Suuuperb!
Thank you.🤝
@@snehitvaddi my pleasure ;)
can SAM do segmentation mask annotation to bounding box or can roboflow add this feature ( like convert all bbox to polygon ) ? please share the collab code or other reference
because I have dataset annotated with segmentation and I want convert to bounding box for research with some model , thank you.
If you save the segmentation dataset in COCO format you will get boxes for free and can use it both in object detection and image segmentation scenarios.
@@Roboflow thank you, but why not add features convert ALL smart polygon to bonding box in annotating mode ? 😅 because maybe we can look it for review the annotations again hehe...
Is it possible to set threshold values for area coverage of similar objects in an image and segment them as same class but with different colored masks depending on their size?
It is but not through UI. You would need to create Python script to do that and interact with Roboflow through the API