Instance Segmentation Model¶
v2¶
Class: RoboflowInstanceSegmentationModelBlockV2
(there are multiple versions of this block)
Warning: This block has multiple versions. Please refer to the specific version for details. You can learn more about how versions work here: Versioning
Run inference on an instance segmentation model hosted on or uploaded to Roboflow.
You can query any model that is private to your account, or any public model available on Roboflow Universe.
You will need to set your Roboflow API key in your Inference environment to use this block. To learn more about setting your Roboflow API key, refer to the Inference documentation.
Type identifier¶
Use the following identifier in step "type"
field: roboflow_core/roboflow_instance_segmentation_model@v2
to add the block as
as step in your workflow.
Properties¶
Name | Type | Description | Refs |
---|---|---|---|
name |
str |
Enter a unique identifier for this step.. | ❌ |
model_id |
str |
Roboflow model identifier. | ✅ |
class_agnostic_nms |
bool |
Value to decide if NMS is to be used in class-agnostic mode.. | ✅ |
class_filter |
List[str] |
List of classes to retrieve from predictions (to define subset of those which was used while model training). | ✅ |
confidence |
float |
Confidence threshold for predictions. | ✅ |
iou_threshold |
float |
Parameter of NMS, to decide on minimum box intersection over union to merge boxes. | ✅ |
max_detections |
int |
Maximum number of detections to return. | ✅ |
max_candidates |
int |
Maximum number of candidates as NMS input to be taken into account.. | ✅ |
mask_decode_mode |
str |
Parameter of mask decoding in prediction post-processing.. | ✅ |
tradeoff_factor |
float |
Post-processing parameter to dictate tradeoff between fast and accurate. | ✅ |
disable_active_learning |
bool |
Parameter to decide if Active Learning data sampling is disabled for the model. | ✅ |
active_learning_target_dataset |
str |
Target dataset for Active Learning data sampling - see Roboflow Active Learning docs for more information. | ✅ |
The Refs column marks possibility to parametrise the property with dynamic values available
in workflow
runtime. See Bindings for more info.
Available Connections¶
Compatible Blocks
Check what blocks you can connect to Instance Segmentation Model
in version v2
.
- inputs:
Stitch Images
,Pixelate Visualization
,Multi-Label Classification Model
,LMM For Classification
,Keypoint Detection Model
,Line Counter
,Instance Segmentation Model
,Blur Visualization
,Single-Label Classification Model
,Mask Visualization
,OCR Model
,Object Detection Model
,SIFT
,Line Counter
,Model Monitoring Inference Aggregator
,Polygon Visualization
,Halo Visualization
,VLM as Detector
,Grid Visualization
,Google Vision OCR
,Model Comparison Visualization
,Email Notification
,Camera Focus
,CogVLM
,Image Threshold
,Keypoint Visualization
,Template Matching
,Image Preprocessing
,Roboflow Dataset Upload
,Slack Notification
,Stitch OCR Detections
,Identify Changes
,Relative Static Crop
,Background Color Visualization
,Clip Comparison
,Bounding Box Visualization
,Ellipse Visualization
,Image Contours
,Label Visualization
,Classification Label Visualization
,Line Counter Visualization
,LMM
,Stability AI Inpainting
,Reference Path Visualization
,VLM as Detector
,Dynamic Crop
,Triangle Visualization
,Absolute Static Crop
,Object Detection Model
,Distance Measurement
,Florence-2 Model
,SIFT Comparison
,Keypoint Detection Model
,Corner Visualization
,Perspective Correction
,Local File Sink
,Polygon Zone Visualization
,VLM as Classifier
,Dimension Collapse
,Image Slicer
,Trace Visualization
,Twilio SMS Notification
,OpenAI
,Detections Consensus
,Webhook Sink
,Roboflow Custom Metadata
,Size Measurement
,Crop Visualization
,Instance Segmentation Model
,Buffer
,Roboflow Dataset Upload
,VLM as Classifier
,Clip Comparison
,Anthropic Claude
,SIFT Comparison
,Image Blur
,Circle Visualization
,Image Convert Grayscale
,Dot Visualization
,Dynamic Zone
,Google Gemini
,JSON Parser
,Single-Label Classification Model
,Identify Outliers
,Florence-2 Model
,OpenAI
,Color Visualization
,Multi-Label Classification Model
,Pixel Color Count
,CSV Formatter
,Llama 3.2 Vision
- outputs:
Time in Zone
,Florence-2 Model
,Path Deviation
,Pixelate Visualization
,Detections Stitch
,Multi-Label Classification Model
,Keypoint Detection Model
,Line Counter
,Instance Segmentation Model
,Keypoint Detection Model
,Corner Visualization
,Blur Visualization
,Single-Label Classification Model
,Mask Visualization
,Object Detection Model
,Perspective Correction
,Line Counter
,Detections Filter
,Model Monitoring Inference Aggregator
,Polygon Visualization
,Halo Visualization
,Trace Visualization
,Model Comparison Visualization
,Size Measurement
,Detections Consensus
,Webhook Sink
,Byte Tracker
,Roboflow Custom Metadata
,Detections Classes Replacement
,Crop Visualization
,Instance Segmentation Model
,Detection Offset
,Roboflow Dataset Upload
,Roboflow Dataset Upload
,Dynamic Zone
,Dot Visualization
,Circle Visualization
,Background Color Visualization
,Segment Anything 2 Model
,Bounding Box Visualization
,Ellipse Visualization
,Label Visualization
,Single-Label Classification Model
,Byte Tracker
,Time in Zone
,Florence-2 Model
,Stability AI Inpainting
,Detections Stabilizer
,Path Deviation
,Dynamic Crop
,Byte Tracker
,Triangle Visualization
,Color Visualization
,Multi-Label Classification Model
,Bounding Rectangle
,Detections Transformation
,Object Detection Model
,Distance Measurement
Input and Output Bindings¶
The available connections depend on its binding kinds. Check what binding kinds
Instance Segmentation Model
in version v2
has.
Bindings
-
input
images
(image
): The image to infer on.model_id
(roboflow_model_id
): Roboflow model identifier.class_agnostic_nms
(boolean
): Value to decide if NMS is to be used in class-agnostic mode..class_filter
(list_of_values
): List of classes to retrieve from predictions (to define subset of those which was used while model training).confidence
(float_zero_to_one
): Confidence threshold for predictions.iou_threshold
(float_zero_to_one
): Parameter of NMS, to decide on minimum box intersection over union to merge boxes.max_detections
(integer
): Maximum number of detections to return.max_candidates
(integer
): Maximum number of candidates as NMS input to be taken into account..mask_decode_mode
(string
): Parameter of mask decoding in prediction post-processing..tradeoff_factor
(float_zero_to_one
): Post-processing parameter to dictate tradeoff between fast and accurate.disable_active_learning
(boolean
): Parameter to decide if Active Learning data sampling is disabled for the model.active_learning_target_dataset
(roboflow_project
): Target dataset for Active Learning data sampling - see Roboflow Active Learning docs for more information.
-
output
inference_id
(inference_id
): Inference identifier.predictions
(instance_segmentation_prediction
): Prediction with detected bounding boxes and segmentation masks in form of sv.Detections(...) object.model_id
(roboflow_model_id
): Roboflow model id.
Example JSON definition of step Instance Segmentation Model
in version v2
{
"name": "<your_step_name_here>",
"type": "roboflow_core/roboflow_instance_segmentation_model@v2",
"images": "$inputs.image",
"model_id": "my_project/3",
"class_agnostic_nms": true,
"class_filter": [
"a",
"b",
"c"
],
"confidence": 0.3,
"iou_threshold": 0.4,
"max_detections": 300,
"max_candidates": 3000,
"mask_decode_mode": "accurate",
"tradeoff_factor": 0.3,
"disable_active_learning": true,
"active_learning_target_dataset": "my_project"
}
v1¶
Class: RoboflowInstanceSegmentationModelBlockV1
(there are multiple versions of this block)
Warning: This block has multiple versions. Please refer to the specific version for details. You can learn more about how versions work here: Versioning
Run inference on an instance segmentation model hosted on or uploaded to Roboflow.
You can query any model that is private to your account, or any public model available on Roboflow Universe.
You will need to set your Roboflow API key in your Inference environment to use this block. To learn more about setting your Roboflow API key, refer to the Inference documentation.
Type identifier¶
Use the following identifier in step "type"
field: roboflow_core/roboflow_instance_segmentation_model@v1
to add the block as
as step in your workflow.
Properties¶
Name | Type | Description | Refs |
---|---|---|---|
name |
str |
Enter a unique identifier for this step.. | ❌ |
model_id |
str |
Roboflow model identifier. | ✅ |
class_agnostic_nms |
bool |
Value to decide if NMS is to be used in class-agnostic mode.. | ✅ |
class_filter |
List[str] |
List of classes to retrieve from predictions (to define subset of those which was used while model training). | ✅ |
confidence |
float |
Confidence threshold for predictions. | ✅ |
iou_threshold |
float |
Parameter of NMS, to decide on minimum box intersection over union to merge boxes. | ✅ |
max_detections |
int |
Maximum number of detections to return. | ✅ |
max_candidates |
int |
Maximum number of candidates as NMS input to be taken into account.. | ✅ |
mask_decode_mode |
str |
Parameter of mask decoding in prediction post-processing.. | ✅ |
tradeoff_factor |
float |
Post-processing parameter to dictate tradeoff between fast and accurate. | ✅ |
disable_active_learning |
bool |
Parameter to decide if Active Learning data sampling is disabled for the model. | ✅ |
active_learning_target_dataset |
str |
Target dataset for Active Learning data sampling - see Roboflow Active Learning docs for more information. | ✅ |
The Refs column marks possibility to parametrise the property with dynamic values available
in workflow
runtime. See Bindings for more info.
Available Connections¶
Compatible Blocks
Check what blocks you can connect to Instance Segmentation Model
in version v1
.
- inputs:
Stitch Images
,Pixelate Visualization
,Multi-Label Classification Model
,LMM For Classification
,Keypoint Detection Model
,Line Counter
,Instance Segmentation Model
,Blur Visualization
,Single-Label Classification Model
,Mask Visualization
,OCR Model
,Object Detection Model
,SIFT
,Line Counter
,Model Monitoring Inference Aggregator
,Polygon Visualization
,Halo Visualization
,VLM as Detector
,Grid Visualization
,Google Vision OCR
,Model Comparison Visualization
,Email Notification
,Camera Focus
,CogVLM
,Image Threshold
,Keypoint Visualization
,Template Matching
,Image Preprocessing
,Roboflow Dataset Upload
,Slack Notification
,Stitch OCR Detections
,Identify Changes
,Relative Static Crop
,Background Color Visualization
,Clip Comparison
,Bounding Box Visualization
,Ellipse Visualization
,Image Contours
,Label Visualization
,Classification Label Visualization
,Line Counter Visualization
,LMM
,Stability AI Inpainting
,Reference Path Visualization
,VLM as Detector
,Dynamic Crop
,Triangle Visualization
,Absolute Static Crop
,Object Detection Model
,Distance Measurement
,Florence-2 Model
,SIFT Comparison
,Keypoint Detection Model
,Corner Visualization
,Perspective Correction
,Local File Sink
,Polygon Zone Visualization
,VLM as Classifier
,Dimension Collapse
,Image Slicer
,Trace Visualization
,Twilio SMS Notification
,OpenAI
,Detections Consensus
,Webhook Sink
,Roboflow Custom Metadata
,Size Measurement
,Crop Visualization
,Instance Segmentation Model
,Buffer
,Roboflow Dataset Upload
,VLM as Classifier
,Clip Comparison
,Anthropic Claude
,SIFT Comparison
,Image Blur
,Circle Visualization
,Image Convert Grayscale
,Dot Visualization
,Dynamic Zone
,Google Gemini
,JSON Parser
,Single-Label Classification Model
,Identify Outliers
,Florence-2 Model
,OpenAI
,Color Visualization
,Multi-Label Classification Model
,Pixel Color Count
,CSV Formatter
,Llama 3.2 Vision
- outputs:
Path Deviation
,Pixelate Visualization
,LMM For Classification
,Line Counter
,Instance Segmentation Model
,CLIP Embedding Model
,Blur Visualization
,Mask Visualization
,Line Counter
,Detections Filter
,YOLO-World Model
,Model Monitoring Inference Aggregator
,Cache Get
,Polygon Visualization
,Halo Visualization
,Google Vision OCR
,Model Comparison Visualization
,Email Notification
,CogVLM
,Image Threshold
,Byte Tracker
,Keypoint Visualization
,Detections Classes Replacement
,Image Preprocessing
,Detection Offset
,Roboflow Dataset Upload
,Slack Notification
,Background Color Visualization
,Bounding Box Visualization
,Ellipse Visualization
,Classification Label Visualization
,Label Visualization
,Line Counter Visualization
,Byte Tracker
,LMM
,Stability AI Inpainting
,Reference Path Visualization
,Dynamic Crop
,Byte Tracker
,Triangle Visualization
,Bounding Rectangle
,Distance Measurement
,Time in Zone
,Detections Stitch
,Florence-2 Model
,SIFT Comparison
,Corner Visualization
,Perspective Correction
,Local File Sink
,Polygon Zone Visualization
,Twilio SMS Notification
,Trace Visualization
,Webhook Sink
,Size Measurement
,OpenAI
,Roboflow Custom Metadata
,Detections Consensus
,Cache Set
,Crop Visualization
,Instance Segmentation Model
,Roboflow Dataset Upload
,Clip Comparison
,Anthropic Claude
,Dynamic Zone
,Image Blur
,Circle Visualization
,Dot Visualization
,Google Gemini
,Segment Anything 2 Model
,Florence-2 Model
,Time in Zone
,Detections Stabilizer
,Path Deviation
,OpenAI
,Color Visualization
,Pixel Color Count
,Llama 3.2 Vision
,Detections Transformation
Input and Output Bindings¶
The available connections depend on its binding kinds. Check what binding kinds
Instance Segmentation Model
in version v1
has.
Bindings
-
input
images
(image
): The image to infer on.model_id
(roboflow_model_id
): Roboflow model identifier.class_agnostic_nms
(boolean
): Value to decide if NMS is to be used in class-agnostic mode..class_filter
(list_of_values
): List of classes to retrieve from predictions (to define subset of those which was used while model training).confidence
(float_zero_to_one
): Confidence threshold for predictions.iou_threshold
(float_zero_to_one
): Parameter of NMS, to decide on minimum box intersection over union to merge boxes.max_detections
(integer
): Maximum number of detections to return.max_candidates
(integer
): Maximum number of candidates as NMS input to be taken into account..mask_decode_mode
(string
): Parameter of mask decoding in prediction post-processing..tradeoff_factor
(float_zero_to_one
): Post-processing parameter to dictate tradeoff between fast and accurate.disable_active_learning
(boolean
): Parameter to decide if Active Learning data sampling is disabled for the model.active_learning_target_dataset
(roboflow_project
): Target dataset for Active Learning data sampling - see Roboflow Active Learning docs for more information.
-
output
inference_id
(string
): String value.predictions
(instance_segmentation_prediction
): Prediction with detected bounding boxes and segmentation masks in form of sv.Detections(...) object.
Example JSON definition of step Instance Segmentation Model
in version v1
{
"name": "<your_step_name_here>",
"type": "roboflow_core/roboflow_instance_segmentation_model@v1",
"images": "$inputs.image",
"model_id": "my_project/3",
"class_agnostic_nms": true,
"class_filter": [
"a",
"b",
"c"
],
"confidence": 0.3,
"iou_threshold": 0.4,
"max_detections": 300,
"max_candidates": 3000,
"mask_decode_mode": "accurate",
"tradeoff_factor": 0.3,
"disable_active_learning": true,
"active_learning_target_dataset": "my_project"
}