Moondream2¶
Class: Moondream2BlockV1
Source: inference.core.workflows.core_steps.models.foundation.moondream2.v1.Moondream2BlockV1
This workflow block runs Moondream2, a multimodal vision-language model. You can use this block to run zero-shot object detection.
Type identifier¶
Use the following identifier in step "type"
field: roboflow_core/moondream2@v1
to add the block as
as step in your workflow.
Properties¶
Name | Type | Description | Refs |
---|---|---|---|
name |
str |
Enter a unique identifier for this step.. | ❌ |
prompt |
str |
Optional text prompt to provide additional context to Moondream2. Otherwise it will just be None. | ❌ |
model_version |
str |
The Moondream2 model to be used for inference.. | ✅ |
The Refs column marks possibility to parametrise the property with dynamic values available
in workflow
runtime. See Bindings for more info.
Available Connections¶
Compatible Blocks
Check what blocks you can connect to Moondream2
in version v1
.
- inputs:
Depth Estimation
,Classification Label Visualization
,Stability AI Image Generation
,Camera Calibration
,Ellipse Visualization
,SIFT
,Blur Visualization
,Circle Visualization
,Dot Visualization
,Image Blur
,Background Color Visualization
,Stitch Images
,Single-Label Classification Model
,Image Slicer
,Absolute Static Crop
,Multi-Label Classification Model
,Object Detection Model
,Color Visualization
,Pixelate Visualization
,Label Visualization
,Stability AI Inpainting
,Keypoint Detection Model
,Polygon Zone Visualization
,Relative Static Crop
,Keypoint Visualization
,Bounding Box Visualization
,Mask Visualization
,Model Comparison Visualization
,Image Preprocessing
,Line Counter Visualization
,Grid Visualization
,SIFT Comparison
,Image Convert Grayscale
,Halo Visualization
,Trace Visualization
,Instance Segmentation Model
,Corner Visualization
,Polygon Visualization
,Triangle Visualization
,Image Contours
,Perspective Correction
,Dynamic Crop
,Crop Visualization
,Camera Focus
,Reference Path Visualization
,Image Slicer
,Image Threshold
- outputs:
Path Deviation
,Ellipse Visualization
,Size Measurement
,Stitch OCR Detections
,Blur Visualization
,Dot Visualization
,Circle Visualization
,Background Color Visualization
,Line Counter
,Byte Tracker
,Roboflow Dataset Upload
,Distance Measurement
,Color Visualization
,Detections Filter
,Byte Tracker
,Pixelate Visualization
,Florence-2 Model
,Byte Tracker
,Label Visualization
,Path Deviation
,Detections Stabilizer
,Roboflow Dataset Upload
,Detections Stitch
,Bounding Box Visualization
,Model Comparison Visualization
,Velocity
,Detections Consensus
,Roboflow Custom Metadata
,Detections Merge
,Detection Offset
,Trace Visualization
,Overlap Filter
,Corner Visualization
,Segment Anything 2 Model
,Triangle Visualization
,Time in Zone
,Model Monitoring Inference Aggregator
,Perspective Correction
,Detections Classes Replacement
,Dynamic Crop
,Crop Visualization
,Time in Zone
,Detections Transformation
,Line Counter
,Florence-2 Model
Input and Output Bindings¶
The available connections depend on its binding kinds. Check what binding kinds
Moondream2
in version v1
has.
Bindings
-
input
images
(image
): The image to infer on..model_version
(roboflow_model_id
): The Moondream2 model to be used for inference..
-
output
predictions
(object_detection_prediction
): Prediction with detected bounding boxes in form of sv.Detections(...) object.
Example JSON definition of step Moondream2
in version v1
{
"name": "<your_step_name_here>",
"type": "roboflow_core/moondream2@v1",
"images": "$inputs.image",
"prompt": "What is in this image?",
"model_version": "moondream2/moondream2-2b"
}