Segment Anything 2 Model¶
Class: SegmentAnything2BlockV1
Source: inference.core.workflows.core_steps.models.foundation.segment_anything2.v1.SegmentAnything2BlockV1
Run Segment Anything 2, a zero-shot instance segmentation model, on an image.
** Dedicated inference server required (GPU recomended) **
You can use pass in boxes/predictions from other models to Segment Anything 2 to use as prompts for the model. If you pass in box detections from another model, the class names of the boxes will be forwarded to the predicted masks. If using the model unprompted, the model will assign integers as class names / ids.
Type identifier¶
Use the following identifier in step "type" field: roboflow_core/segment_anything@v1to add the block as
as step in your workflow.
Properties¶
| Name | Type | Description | Refs |
|---|---|---|---|
name |
str |
Enter a unique identifier for this step.. | ❌ |
version |
str |
Model to be used. One of hiera_large, hiera_small, hiera_tiny, hiera_b_plus. | ✅ |
threshold |
float |
Threshold for predicted masks scores. | ✅ |
multimask_output |
bool |
Flag to determine whether to use sam2 internal multimask or single mask mode. For ambiguous prompts setting to True is recomended.. | ✅ |
The Refs column marks possibility to parametrise the property with dynamic values available
in workflow runtime. See Bindings for more info.
Available Connections¶
Compatible Blocks
Check what blocks you can connect to Segment Anything 2 Model in version v1.
- inputs:
Pixelate Visualization,Roboflow Custom Metadata,Halo Visualization,Anthropic Claude,OpenAI,Halo Visualization,Ellipse Visualization,Webhook Sink,Dynamic Crop,Image Convert Grayscale,Circle Visualization,Florence-2 Model,Image Slicer,Stability AI Outpainting,Dynamic Zone,Detections Combine,EasyOCR,Byte Tracker,OCR Model,Anthropic Claude,Twilio SMS Notification,Stability AI Inpainting,SIFT Comparison,Stitch OCR Detections,Image Blur,VLM As Classifier,QR Code Generator,JSON Parser,Object Detection Model,SIFT,OpenAI,Path Deviation,Detections Stitch,YOLO-World Model,PTZ Tracking (ONVIF),Slack Notification,Detections Filter,Detection Offset,Detections List Roll-Up,Keypoint Detection Model,Segment Anything 2 Model,LMM,Image Threshold,Overlap Filter,Detections Merge,Relative Static Crop,Identify Changes,Keypoint Detection Model,Crop Visualization,Template Matching,Stitch Images,Perspective Correction,Motion Detection,Camera Focus,Line Counter Visualization,Color Visualization,Morphological Transformation,Llama 3.2 Vision,Line Counter,Google Gemini,SAM 3,Time in Zone,Identify Outliers,OpenAI,Roboflow Dataset Upload,Google Gemini,Object Detection Model,Polygon Visualization,Heatmap Visualization,Time in Zone,Contrast Equalization,Trace Visualization,Grid Visualization,Model Monitoring Inference Aggregator,Local File Sink,Detection Event Log,Corner Visualization,Polygon Zone Visualization,Model Comparison Visualization,Keypoint Visualization,Text Display,Google Vision OCR,Moondream2,Detections Stabilizer,Roboflow Dataset Upload,Reference Path Visualization,Cosine Similarity,CogVLM,Instance Segmentation Model,LMM For Classification,VLM As Detector,Image Slicer,Icon Visualization,Background Color Visualization,Absolute Static Crop,Google Gemini,Label Visualization,Image Preprocessing,Classification Label Visualization,Mask Visualization,Single-Label Classification Model,VLM As Classifier,Detections Consensus,Bounding Box Visualization,Mask Area Measurement,Byte Tracker,OpenAI,Triangle Visualization,Dot Visualization,Email Notification,Twilio SMS/MMS Notification,Image Contours,Byte Tracker,Anthropic Claude,Instance Segmentation Model,Stitch OCR Detections,Seg Preview,Email Notification,Florence-2 Model,Background Subtraction,Bounding Rectangle,SAM 3,Camera Calibration,VLM As Detector,Clip Comparison,Gaze Detection,Detections Classes Replacement,Velocity,Blur Visualization,Path Deviation,CSV Formatter,Camera Focus,Detections Transformation,SAM 3,SIFT Comparison,Multi-Label Classification Model,Qwen3.5-VL,Time in Zone,Stability AI Image Generation,Depth Estimation,Polygon Visualization - outputs:
Path Deviation,Roboflow Custom Metadata,Heatmap Visualization,Line Counter,Detections Stitch,Halo Visualization,Pixelate Visualization,Byte Tracker,Mask Visualization,Time in Zone,Bounding Box Visualization,Detections Consensus,Distance Measurement,PTZ Tracking (ONVIF),Mask Area Measurement,Halo Visualization,Detections Filter,Detection Offset,Triangle Visualization,Trace Visualization,Detections List Roll-Up,Dot Visualization,Ellipse Visualization,Model Monitoring Inference Aggregator,Segment Anything 2 Model,Dynamic Crop,Detection Event Log,Byte Tracker,Corner Visualization,Circle Visualization,Model Comparison Visualization,Florence-2 Model,Florence-2 Model,Bounding Rectangle,Dynamic Zone,Overlap Filter,Detections Merge,Detections Combine,Byte Tracker,Crop Visualization,Size Measurement,Detections Stabilizer,Detections Classes Replacement,Velocity,Stability AI Inpainting,Roboflow Dataset Upload,Blur Visualization,Perspective Correction,Path Deviation,Camera Focus,Detections Transformation,Color Visualization,Line Counter,Time in Zone,Icon Visualization,Background Color Visualization,Label Visualization,Time in Zone,Roboflow Dataset Upload,Polygon Visualization,Polygon Visualization
Input and Output Bindings¶
The available connections depend on its binding kinds. Check what binding kinds
Segment Anything 2 Model in version v1 has.
Bindings
-
input
images(image): The image to infer on..boxes(Union[object_detection_prediction,instance_segmentation_prediction,keypoint_detection_prediction]): Bounding boxes (from another model) to convert to polygons.version(string): Model to be used. One of hiera_large, hiera_small, hiera_tiny, hiera_b_plus.threshold(float): Threshold for predicted masks scores.multimask_output(boolean): Flag to determine whether to use sam2 internal multimask or single mask mode. For ambiguous prompts setting to True is recomended..
-
output
predictions(instance_segmentation_prediction): Prediction with detected bounding boxes and segmentation masks in form of sv.Detections(...) object.
Example JSON definition of step Segment Anything 2 Model in version v1
{
"name": "<your_step_name_here>",
"type": "roboflow_core/segment_anything@v1",
"images": "$inputs.image",
"boxes": "$steps.object_detection_model.predictions",
"version": "hiera_large",
"threshold": 0.3,
"multimask_output": true
}