Moondream2¶
Class: Moondream2BlockV1
Source: inference.core.workflows.core_steps.models.foundation.moondream2.v1.Moondream2BlockV1
This workflow block runs Moondream2, a multimodal vision-language model. You can use this block to run zero-shot object detection.
Type identifier¶
Use the following identifier in step "type" field: roboflow_core/moondream2@v1to add the block as
as step in your workflow.
Properties¶
| Name | Type | Description | Refs |
|---|---|---|---|
name |
str |
Enter a unique identifier for this step.. | ❌ |
prompt |
str |
Optional text prompt to provide additional context to Moondream2.. | ✅ |
model_version |
str |
The Moondream2 model to be used for inference.. | ✅ |
The Refs column marks possibility to parametrise the property with dynamic values available
in workflow runtime. See Bindings for more info.
Available Connections¶
Compatible Blocks
Check what blocks you can connect to Moondream2 in version v1.
- inputs:
Florence-2 Model,Trace Visualization,Roboflow Dataset Upload,Classification Label Visualization,Stitch Images,Single-Label Classification Model,Image Slicer,Ellipse Visualization,Crop Visualization,Grid Visualization,Morphological Transformation,Triangle Visualization,Reference Path Visualization,Roboflow Dataset Upload,Google Gemini,LMM,Stitch OCR Detections,Twilio SMS/MMS Notification,Multi-Label Classification Model,Image Slicer,Local File Sink,VLM As Classifier,Icon Visualization,QR Code Generator,Stability AI Outpainting,OpenAI,Keypoint Detection Model,Florence-2 Model,Google Vision OCR,Camera Focus,Pixelate Visualization,Model Comparison Visualization,Object Detection Model,Image Preprocessing,Background Color Visualization,Clip Comparison,Color Visualization,Twilio SMS Notification,Polygon Zone Visualization,OpenAI,Halo Visualization,Background Subtraction,Keypoint Detection Model,Keypoint Visualization,Instance Segmentation Model,Contrast Equalization,EasyOCR,Image Blur,Polygon Visualization,Anthropic Claude,SIFT,Google Gemini,Webhook Sink,Perspective Correction,Object Detection Model,Circle Visualization,Blur Visualization,Dot Visualization,Camera Calibration,Heatmap Visualization,Image Threshold,Multi-Label Classification Model,Relative Static Crop,Google Gemini,Text Display,Email Notification,OpenAI,Instance Segmentation Model,Single-Label Classification Model,Anthropic Claude,Depth Estimation,Mask Visualization,CSV Formatter,Stability AI Image Generation,Halo Visualization,Absolute Static Crop,OCR Model,Label Visualization,Stability AI Inpainting,Anthropic Claude,Corner Visualization,Image Convert Grayscale,Stitch OCR Detections,Roboflow Custom Metadata,SIFT Comparison,Polygon Visualization,CogVLM,VLM As Detector,Line Counter Visualization,Bounding Box Visualization,Llama 3.2 Vision,Camera Focus,Email Notification,Slack Notification,Dynamic Crop,Image Contours,Model Monitoring Inference Aggregator,LMM For Classification,OpenAI - outputs:
Florence-2 Model,Detections Combine,Trace Visualization,Roboflow Dataset Upload,Perspective Correction,Circle Visualization,Blur Visualization,Segment Anything 2 Model,Dot Visualization,Line Counter,Ellipse Visualization,Line Counter,Byte Tracker,Heatmap Visualization,Distance Measurement,Detections Stabilizer,Crop Visualization,Triangle Visualization,Path Deviation,Detection Event Log,Stitch OCR Detections,Roboflow Dataset Upload,Detections Classes Replacement,Time in Zone,Icon Visualization,Path Deviation,Detection Offset,Detections Filter,Florence-2 Model,Byte Tracker,Detections Transformation,Size Measurement,Pixelate Visualization,Detections Stitch,Model Comparison Visualization,Label Visualization,Detections Consensus,Detections Merge,Corner Visualization,Roboflow Custom Metadata,Background Color Visualization,Stitch OCR Detections,Color Visualization,Time in Zone,Velocity,Time in Zone,Detections List Roll-Up,Mask Area Measurement,Bounding Box Visualization,PTZ Tracking (ONVIF),Camera Focus,Byte Tracker,Dynamic Crop,Overlap Filter,Model Monitoring Inference Aggregator
Input and Output Bindings¶
The available connections depend on its binding kinds. Check what binding kinds
Moondream2 in version v1 has.
Bindings
-
input
images(image): The image to infer on..prompt(string): Optional text prompt to provide additional context to Moondream2..model_version(roboflow_model_id): The Moondream2 model to be used for inference..
-
output
predictions(object_detection_prediction): Prediction with detected bounding boxes in form of sv.Detections(...) object.
Example JSON definition of step Moondream2 in version v1
{
"name": "<your_step_name_here>",
"type": "roboflow_core/moondream2@v1",
"images": "$inputs.image",
"prompt": "my prompt",
"model_version": "moondream2/moondream2_2b_jul24"
}