Moondream2

Class: Moondream2BlockV1

Source: inference.core.workflows.core_steps.models.foundation.moondream2.v1.Moondream2BlockV1

('This workflow block runs Moondream2, a multimodal vision-language model. You can use this block to run zero-shot object detection.',)

Type identifier

Use the following identifier in step "type" field: roboflow_core/moondream2@v1to add the block as as step in your workflow.

Properties

Name	Type	Description	Refs
name	str	Enter a unique identifier for this step..	❌
prompt	str	Optional text prompt to provide additional context to Moondream2. Otherwise it will just be None.	❌
model_version	str	The Moondream2 model to be used for inference..	✅

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections

Compatible Blocks

Check what blocks you can connect to Moondream2 in version v1.

• inputs: Image Convert Grayscale, Absolute Static Crop, Relative Static Crop, Label Visualization, Line Counter Visualization, Background Color Visualization, Stitch Images, Camera Focus, Image Contours, Image Preprocessing, Image Slicer, Reference Path Visualization, SIFT Comparison, Triangle Visualization, Grid Visualization, Polygon Zone Visualization, Multi-Label Classification Model, Keypoint Visualization, Depth Estimation, Bounding Box Visualization, Image Blur, Perspective Correction, Halo Visualization, Object Detection Model, Ellipse Visualization, Color Visualization, Crop Visualization, Dot Visualization, Pixelate Visualization, Single-Label Classification Model, Model Comparison Visualization, Classification Label Visualization, Camera Calibration, Instance Segmentation Model, Stability AI Image Generation, Polygon Visualization, Trace Visualization, Corner Visualization, Image Threshold, Blur Visualization, Image Slicer, Stability AI Inpainting, Keypoint Detection Model, Mask Visualization, SIFT, Circle Visualization, Dynamic Crop
• outputs: Size Measurement, Detection Offset, Roboflow Custom Metadata, Path Deviation, Florence-2 Model, Distance Measurement, Label Visualization, Detections Classes Replacement, Background Color Visualization, Detections Stitch, Byte Tracker, Triangle Visualization, Path Deviation, Line Counter, Detections Stabilizer, Detections Transformation, Byte Tracker, Stitch OCR Detections, Roboflow Dataset Upload, Bounding Box Visualization, Perspective Correction, Ellipse Visualization, Color Visualization, Crop Visualization, Dot Visualization, Pixelate Visualization, Detections Filter, Model Comparison Visualization, Detections Merge, Velocity, Overlap Filter, Roboflow Dataset Upload, Segment Anything 2 Model, Time in Zone, Line Counter, Time in Zone, Trace Visualization, Corner Visualization, Blur Visualization, Model Monitoring Inference Aggregator, Florence-2 Model, Circle Visualization, Byte Tracker, Dynamic Crop, Detections Consensus

Input and Output Bindings

The available connections depend on its binding kinds. Check what binding kinds Moondream2 in version v1 has.

Bindings

• input

  • images (image): The image to infer on..
  • model_version (roboflow_model_id): The Moondream2 model to be used for inference..

• output

  • predictions (object_detection_prediction): Prediction with detected bounding boxes in form of sv.Detections(...) object.

Example JSON definition of step Moondream2 in version v1

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/moondream2@v1",
    "images": "$inputs.image",
    "prompt": "What is in this image?",
    "model_version": "moondream2/moondream2-2b"
}