Moondream2

Class: Moondream2BlockV1

Source: inference.core.workflows.core_steps.models.foundation.moondream2.v1.Moondream2BlockV1

This workflow block runs Moondream2, a multimodal vision-language model. You can use this block to run zero-shot object detection.

Type identifier

Use the following identifier in step "type" field: roboflow_core/moondream2@v1to add the block as as step in your workflow.

Properties

Name	Type	Description	Refs
name	str	Enter a unique identifier for this step..	❌
prompt	str	Optional text prompt to provide additional context to Moondream2. Otherwise it will just be None.	❌
model_version	str	The Moondream2 model to be used for inference..	✅

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections

Compatible Blocks

Check what blocks you can connect to Moondream2 in version v1.

• inputs: Stability AI Inpainting, Single-Label Classification Model, Label Visualization, Depth Estimation, Corner Visualization, Triangle Visualization, Background Color Visualization, Image Blur, Polygon Zone Visualization, Model Comparison Visualization, Line Counter Visualization, Camera Focus, Circle Visualization, Perspective Correction, Relative Static Crop, Grid Visualization, Stability AI Image Generation, Trace Visualization, Image Slicer, Blur Visualization, Classification Label Visualization, Object Detection Model, Image Convert Grayscale, Image Preprocessing, SIFT Comparison, Stitch Images, Reference Path Visualization, Stability AI Outpainting, Polygon Visualization, Camera Calibration, Mask Visualization, SIFT, Bounding Box Visualization, Image Threshold, Keypoint Visualization, Ellipse Visualization, Crop Visualization, Color Visualization, Pixelate Visualization, Image Slicer, Dynamic Crop, Image Contours, Absolute Static Crop, Halo Visualization, Instance Segmentation Model, Dot Visualization, Multi-Label Classification Model, Keypoint Detection Model
• outputs: Line Counter, Florence-2 Model, Model Monitoring Inference Aggregator, Label Visualization, Florence-2 Model, Overlap Filter, Corner Visualization, Triangle Visualization, Background Color Visualization, Byte Tracker, Model Comparison Visualization, Detections Transformation, Circle Visualization, Perspective Correction, Line Counter, Detections Stitch, Trace Visualization, Byte Tracker, Blur Visualization, Time in Zone, Path Deviation, Byte Tracker, Detections Consensus, Velocity, Detections Stabilizer, Detection Offset, Detections Filter, Size Measurement, Time in Zone, Roboflow Dataset Upload, Segment Anything 2 Model, Detections Merge, Roboflow Custom Metadata, Bounding Box Visualization, Path Deviation, Distance Measurement, Ellipse Visualization, Crop Visualization, Color Visualization, Pixelate Visualization, Stitch OCR Detections, PTZ Tracking (ONVIF).md), Dynamic Crop, Detections Classes Replacement, Dot Visualization, Roboflow Dataset Upload

Input and Output Bindings

The available connections depend on its binding kinds. Check what binding kinds Moondream2 in version v1 has.

Bindings

• input

  • images (image): The image to infer on..
  • model_version (roboflow_model_id): The Moondream2 model to be used for inference..

• output

  • predictions (object_detection_prediction): Prediction with detected bounding boxes in form of sv.Detections(...) object.

Example JSON definition of step Moondream2 in version v1

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/moondream2@v1",
    "images": "$inputs.image",
    "prompt": "What is in this image?",
    "model_version": "moondream2/moondream2_2b_jul24"
}