Instance Segmentation Model

v2

Class: RoboflowInstanceSegmentationModelBlockV2 (there are multiple versions of this block)

Source: inference.core.workflows.core_steps.models.roboflow.instance_segmentation.v2.RoboflowInstanceSegmentationModelBlockV2

Warning: This block has multiple versions. Please refer to the specific version for details. You can learn more about how versions work here: Versioning

Run inference on an instance segmentation model hosted on or uploaded to Roboflow.

You can query any model that is private to your account, or any public model available on Roboflow Universe.

You will need to set your Roboflow API key in your Inference environment to use this block. To learn more about setting your Roboflow API key, refer to the Inference documentation.

Type identifier

Use the following identifier in step "type" field: roboflow_core/roboflow_instance_segmentation_model@v2to add the block as as step in your workflow.

Properties

Name	Type	Description	Refs
name	str	Enter a unique identifier for this step..	❌
model_id	str	Roboflow model identifier..	✅
confidence	float	Confidence threshold for predictions..	✅
class_filter	List[str]	List of accepted classes. Classes must exist in the model's training set..	✅
iou_threshold	float	Minimum overlap threshold between boxes to combine them into a single detection, used in NMS. Learn more..	✅
max_detections	int	Maximum number of detections to return..	✅
class_agnostic_nms	bool	Boolean flag to specify if NMS is to be used in class-agnostic mode..	✅
max_candidates	int	Maximum number of candidates as NMS input to be taken into account..	✅
mask_decode_mode	str	Parameter of mask decoding in prediction post-processing..	✅
tradeoff_factor	float	Post-processing parameter to dictate tradeoff between fast and accurate..	✅
disable_active_learning	bool	Boolean flag to disable project-level active learning for this block..	✅
active_learning_target_dataset	str	Target dataset for active learning, if enabled..	✅

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections

Compatible Blocks

Check what blocks you can connect to Instance Segmentation Model in version v2.

• inputs: Keypoint Detection Model, CogVLM, Image Convert Grayscale, Anthropic Claude, OpenAI, Google Vision OCR, Florence-2 Model, Distance Measurement, Pixelate Visualization, Dimension Collapse, Single-Label Classification Model, SIFT, VLM as Detector, OpenAI, Stability AI Image Generation, SIFT Comparison, Mask Visualization, Object Detection Model, Image Slicer, Triangle Visualization, VLM as Detector, CSV Formatter, Polygon Zone Visualization, Model Comparison Visualization, Crop Visualization, Classification Label Visualization, LMM, Keypoint Detection Model, Reference Path Visualization, Multi-Label Classification Model, Line Counter, Twilio SMS Notification, Google Gemini, Bounding Box Visualization, Image Contours, Roboflow Custom Metadata, Size Measurement, Circle Visualization, Perspective Correction, Slack Notification, Pixel Color Count, Polygon Visualization, Instance Segmentation Model, VLM as Classifier, Trace Visualization, Webhook Sink, Color Visualization, Identify Changes, Detections Consensus, LMM For Classification, Image Threshold, SIFT Comparison, JSON Parser, Absolute Static Crop, Clip Comparison, Line Counter Visualization, Stitch Images, Multi-Label Classification Model, Line Counter, Dot Visualization, Identify Outliers, Dynamic Zone, Instance Segmentation Model, Background Color Visualization, Florence-2 Model, Model Monitoring Inference Aggregator, Stitch OCR Detections, Image Slicer, Template Matching, Roboflow Dataset Upload, Roboflow Dataset Upload, Image Blur, Email Notification, Camera Focus, Grid Visualization, Object Detection Model, Blur Visualization, Label Visualization, Stability AI Inpainting, Depth Estimation, Image Preprocessing, Llama 3.2 Vision, Ellipse Visualization, ONVIF Control, VLM as Classifier, Halo Visualization, Corner Visualization, Camera Calibration, Clip Comparison, Buffer, Dynamic Crop, Single-Label Classification Model, Relative Static Crop, OpenAI, Keypoint Visualization, OCR Model, Local File Sink
• outputs: Keypoint Detection Model, Detections Stitch, Detections Classes Replacement, Florence-2 Model, Detection Offset, Distance Measurement, Pixelate Visualization, SmolVLM2, Single-Label Classification Model, Qwen2.5-VL, Multi-Label Classification Model, Line Counter, Moondream2, Mask Visualization, Detections Filter, Overlap Filter, Dot Visualization, Object Detection Model, Dynamic Zone, Instance Segmentation Model, Background Color Visualization, Florence-2 Model, Model Monitoring Inference Aggregator, Detections Stabilizer, Triangle Visualization, Bounding Rectangle, Path Deviation, Roboflow Dataset Upload, Roboflow Dataset Upload, Time in Zone, Path Deviation, Object Detection Model, Model Comparison Visualization, Crop Visualization, Stability AI Inpainting, Blur Visualization, Segment Anything 2 Model, Label Visualization, Byte Tracker, Keypoint Detection Model, Multi-Label Classification Model, Ellipse Visualization, ONVIF Control, Byte Tracker, Line Counter, Bounding Box Visualization, Halo Visualization, Roboflow Custom Metadata, Byte Tracker, Size Measurement, Corner Visualization, Time in Zone, Circle Visualization, Perspective Correction, Dynamic Crop, Polygon Visualization, Detections Transformation, Single-Label Classification Model, Instance Segmentation Model, Detections Merge, Trace Visualization, Webhook Sink, Velocity, Color Visualization, Detections Consensus

Input and Output Bindings

The available connections depend on its binding kinds. Check what binding kinds Instance Segmentation Model in version v2 has.

Bindings

• input

  • images (image): The image to infer on..
  • model_id (roboflow_model_id): Roboflow model identifier..
  • confidence (float_zero_to_one): Confidence threshold for predictions..
  • class_filter (list_of_values): List of accepted classes. Classes must exist in the model's training set..
  • iou_threshold (float_zero_to_one): Minimum overlap threshold between boxes to combine them into a single detection, used in NMS. Learn more..
  • max_detections (integer): Maximum number of detections to return..
  • class_agnostic_nms (boolean): Boolean flag to specify if NMS is to be used in class-agnostic mode..
  • max_candidates (integer): Maximum number of candidates as NMS input to be taken into account..
  • mask_decode_mode (string): Parameter of mask decoding in prediction post-processing..
  • tradeoff_factor (float_zero_to_one): Post-processing parameter to dictate tradeoff between fast and accurate..
  • disable_active_learning (boolean): Boolean flag to disable project-level active learning for this block..
  • active_learning_target_dataset (roboflow_project): Target dataset for active learning, if enabled..

• output

  • inference_id (inference_id): Inference identifier.
  • predictions (instance_segmentation_prediction): Prediction with detected bounding boxes and segmentation masks in form of sv.Detections(...) object.
  • model_id (roboflow_model_id): Roboflow model id.

Example JSON definition of step Instance Segmentation Model in version v2

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/roboflow_instance_segmentation_model@v2",
    "images": "$inputs.image",
    "model_id": "my_project/3",
    "confidence": 0.3,
    "class_filter": [
        "a",
        "b",
        "c"
    ],
    "iou_threshold": 0.4,
    "max_detections": 300,
    "class_agnostic_nms": true,
    "max_candidates": 3000,
    "mask_decode_mode": "accurate",
    "tradeoff_factor": 0.3,
    "disable_active_learning": true,
    "active_learning_target_dataset": "my_project"
}

v1

Class: RoboflowInstanceSegmentationModelBlockV1 (there are multiple versions of this block)

Source: inference.core.workflows.core_steps.models.roboflow.instance_segmentation.v1.RoboflowInstanceSegmentationModelBlockV1

Warning: This block has multiple versions. Please refer to the specific version for details. You can learn more about how versions work here: Versioning

Run inference on an instance segmentation model hosted on or uploaded to Roboflow.

You can query any model that is private to your account, or any public model available on Roboflow Universe.

You will need to set your Roboflow API key in your Inference environment to use this block. To learn more about setting your Roboflow API key, refer to the Inference documentation.

Type identifier

Use the following identifier in step "type" field: roboflow_core/roboflow_instance_segmentation_model@v1to add the block as as step in your workflow.

Properties

Name	Type	Description	Refs
name	str	Enter a unique identifier for this step..	❌
model_id	str	Roboflow model identifier..	✅
confidence	float	Confidence threshold for predictions..	✅
class_filter	List[str]	List of accepted classes. Classes must exist in the model's training set..	✅
iou_threshold	float	Minimum overlap threshold between boxes to combine them into a single detection, used in NMS. Learn more..	✅
max_detections	int	Maximum number of detections to return..	✅
class_agnostic_nms	bool	Boolean flag to specify if NMS is to be used in class-agnostic mode..	✅
max_candidates	int	Maximum number of candidates as NMS input to be taken into account..	✅
mask_decode_mode	str	Parameter of mask decoding in prediction post-processing..	✅
tradeoff_factor	float	Post-processing parameter to dictate tradeoff between fast and accurate..	✅
disable_active_learning	bool	Boolean flag to disable project-level active learning for this block..	✅
active_learning_target_dataset	str	Target dataset for active learning, if enabled..	✅

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections

Compatible Blocks

Check what blocks you can connect to Instance Segmentation Model in version v1.

• inputs: Keypoint Detection Model, CogVLM, Image Convert Grayscale, Anthropic Claude, OpenAI, Google Vision OCR, Florence-2 Model, Distance Measurement, Pixelate Visualization, Dimension Collapse, Single-Label Classification Model, SIFT, VLM as Detector, OpenAI, Stability AI Image Generation, SIFT Comparison, Mask Visualization, Object Detection Model, Image Slicer, Triangle Visualization, VLM as Detector, CSV Formatter, Polygon Zone Visualization, Model Comparison Visualization, Crop Visualization, Classification Label Visualization, LMM, Keypoint Detection Model, Reference Path Visualization, Multi-Label Classification Model, Line Counter, Twilio SMS Notification, Google Gemini, Bounding Box Visualization, Image Contours, Roboflow Custom Metadata, Size Measurement, Circle Visualization, Perspective Correction, Slack Notification, Pixel Color Count, Polygon Visualization, Instance Segmentation Model, VLM as Classifier, Trace Visualization, Webhook Sink, Color Visualization, Identify Changes, Detections Consensus, LMM For Classification, Image Threshold, SIFT Comparison, JSON Parser, Absolute Static Crop, Clip Comparison, Line Counter Visualization, Stitch Images, Multi-Label Classification Model, Line Counter, Dot Visualization, Identify Outliers, Dynamic Zone, Instance Segmentation Model, Background Color Visualization, Florence-2 Model, Model Monitoring Inference Aggregator, Stitch OCR Detections, Image Slicer, Template Matching, Roboflow Dataset Upload, Roboflow Dataset Upload, Image Blur, Email Notification, Camera Focus, Grid Visualization, Object Detection Model, Blur Visualization, Label Visualization, Stability AI Inpainting, Depth Estimation, Image Preprocessing, Llama 3.2 Vision, Ellipse Visualization, ONVIF Control, VLM as Classifier, Halo Visualization, Corner Visualization, Camera Calibration, Clip Comparison, Buffer, Dynamic Crop, Single-Label Classification Model, Relative Static Crop, OpenAI, Keypoint Visualization, OCR Model, Local File Sink
• outputs: CogVLM, Anthropic Claude, Cache Set, Google Vision OCR, OpenAI, Detections Classes Replacement, Florence-2 Model, Detection Offset, Distance Measurement, Pixelate Visualization, OpenAI, Stability AI Image Generation, YOLO-World Model, Mask Visualization, Overlap Filter, Triangle Visualization, Path Deviation, Polygon Zone Visualization, Model Comparison Visualization, Crop Visualization, LMM, Classification Label Visualization, Segment Anything 2 Model, Reference Path Visualization, Twilio SMS Notification, Line Counter, Google Gemini, Bounding Box Visualization, Roboflow Custom Metadata, Byte Tracker, Size Measurement, Circle Visualization, Perspective Correction, Slack Notification, Pixel Color Count, Polygon Visualization, Detections Transformation, Instance Segmentation Model, Trace Visualization, Detections Merge, Webhook Sink, Color Visualization, LMM For Classification, Detections Consensus, Image Threshold, Detections Stitch, SIFT Comparison, Line Counter Visualization, Line Counter, Dot Visualization, Detections Filter, Dynamic Zone, Instance Segmentation Model, Florence-2 Model, Background Color Visualization, Model Monitoring Inference Aggregator, Detections Stabilizer, Bounding Rectangle, Roboflow Dataset Upload, Roboflow Dataset Upload, Image Blur, Time in Zone, Email Notification, Path Deviation, CLIP Embedding Model, Stability AI Inpainting, Label Visualization, Blur Visualization, Llama 3.2 Vision, Image Preprocessing, Byte Tracker, Ellipse Visualization, ONVIF Control, Byte Tracker, Halo Visualization, Corner Visualization, Clip Comparison, Cache Get, Time in Zone, Dynamic Crop, OpenAI, Keypoint Visualization, Velocity, Local File Sink

Input and Output Bindings

The available connections depend on its binding kinds. Check what binding kinds Instance Segmentation Model in version v1 has.

Bindings

• input

  • images (image): The image to infer on..
  • model_id (roboflow_model_id): Roboflow model identifier..
  • confidence (float_zero_to_one): Confidence threshold for predictions..
  • class_filter (list_of_values): List of accepted classes. Classes must exist in the model's training set..
  • iou_threshold (float_zero_to_one): Minimum overlap threshold between boxes to combine them into a single detection, used in NMS. Learn more..
  • max_detections (integer): Maximum number of detections to return..
  • class_agnostic_nms (boolean): Boolean flag to specify if NMS is to be used in class-agnostic mode..
  • max_candidates (integer): Maximum number of candidates as NMS input to be taken into account..
  • mask_decode_mode (string): Parameter of mask decoding in prediction post-processing..
  • tradeoff_factor (float_zero_to_one): Post-processing parameter to dictate tradeoff between fast and accurate..
  • disable_active_learning (boolean): Boolean flag to disable project-level active learning for this block..
  • active_learning_target_dataset (roboflow_project): Target dataset for active learning, if enabled..

• output

  • inference_id (string): String value.
  • predictions (instance_segmentation_prediction): Prediction with detected bounding boxes and segmentation masks in form of sv.Detections(...) object.

Example JSON definition of step Instance Segmentation Model in version v1

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/roboflow_instance_segmentation_model@v1",
    "images": "$inputs.image",
    "model_id": "my_project/3",
    "confidence": 0.3,
    "class_filter": [
        "a",
        "b",
        "c"
    ],
    "iou_threshold": 0.4,
    "max_detections": 300,
    "class_agnostic_nms": true,
    "max_candidates": 3000,
    "mask_decode_mode": "accurate",
    "tradeoff_factor": 0.3,
    "disable_active_learning": true,
    "active_learning_target_dataset": "my_project"
}