Moondream2

Class: Moondream2BlockV1

Source: inference.core.workflows.core_steps.models.foundation.moondream2.v1.Moondream2BlockV1

This workflow block runs Moondream2, a multimodal vision-language model. You can use this block to run zero-shot object detection.

Type identifier

Use the following identifier in step "type" field: roboflow_core/moondream2@v1to add the block as as step in your workflow.

Properties

Name	Type	Description	Refs
name	str	Enter a unique identifier for this step..	❌
prompt	str	Optional text prompt to provide additional context to Moondream2..	✅
model_version	str	The Moondream2 model to be used for inference..	✅

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections

Compatible Blocks

Check what blocks you can connect to Moondream2 in version v1.

• inputs: OpenAI, VLM as Detector, Keypoint Detection Model, Circle Visualization, Roboflow Dataset Upload, Roboflow Custom Metadata, Depth Estimation, SIFT, Florence-2 Model, Single-Label Classification Model, Grid Visualization, Instance Segmentation Model, Color Visualization, CSV Formatter, Object Detection Model, Perspective Correction, Model Monitoring Inference Aggregator, Image Slicer, OpenAI, Keypoint Detection Model, Model Comparison Visualization, Clip Comparison, Stitch Images, Dynamic Crop, Image Contours, Webhook Sink, Pixelate Visualization, Llama 3.2 Vision, Camera Calibration, Reference Path Visualization, Image Blur, Local File Sink, Blur Visualization, OCR Model, Ellipse Visualization, Trace Visualization, Corner Visualization, Camera Focus, Polygon Zone Visualization, Google Gemini, OpenAI, Triangle Visualization, Stability AI Inpainting, Classification Label Visualization, Single-Label Classification Model, Bounding Box Visualization, CogVLM, Image Convert Grayscale, Halo Visualization, LMM, Email Notification, Polygon Visualization, Absolute Static Crop, Object Detection Model, Slack Notification, Dot Visualization, Label Visualization, Stability AI Outpainting, Crop Visualization, Google Vision OCR, Stability AI Image Generation, Image Threshold, Stitch OCR Detections, Image Preprocessing, SIFT Comparison, Mask Visualization, Florence-2 Model, Twilio SMS Notification, Roboflow Dataset Upload, Line Counter Visualization, VLM as Classifier, Anthropic Claude, Background Color Visualization, LMM For Classification, Instance Segmentation Model, Multi-Label Classification Model, Image Slicer, Keypoint Visualization, Multi-Label Classification Model, Relative Static Crop
• outputs: Corner Visualization, Detections Classes Replacement, Trace Visualization, Roboflow Dataset Upload, Circle Visualization, PTZ Tracking (ONVIF).md), Triangle Visualization, Roboflow Custom Metadata, Detections Transformation, Bounding Box Visualization, Florence-2 Model, Detections Stabilizer, Distance Measurement, Detections Merge, Detections Stitch, Byte Tracker, Label Visualization, Dot Visualization, Color Visualization, Detections Consensus, Crop Visualization, Overlap Filter, Detections Filter, Perspective Correction, Path Deviation, Model Monitoring Inference Aggregator, Detection Offset, Stitch OCR Detections, Model Comparison Visualization, Dynamic Crop, Time in Zone, Florence-2 Model, Segment Anything 2 Model, Pixelate Visualization, Roboflow Dataset Upload, Byte Tracker, Line Counter, Byte Tracker, Time in Zone, Path Deviation, Background Color Visualization, Velocity, Line Counter, Blur Visualization, Ellipse Visualization, Size Measurement

Input and Output Bindings

The available connections depend on its binding kinds. Check what binding kinds Moondream2 in version v1 has.

Bindings

• input

  • images (image): The image to infer on..
  • prompt (string): Optional text prompt to provide additional context to Moondream2..
  • model_version (roboflow_model_id): The Moondream2 model to be used for inference..

• output

  • predictions (object_detection_prediction): Prediction with detected bounding boxes in form of sv.Detections(...) object.

Example JSON definition of step Moondream2 in version v1

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/moondream2@v1",
    "images": "$inputs.image",
    "prompt": "my prompt",
    "model_version": "moondream2/moondream2_2b_jul24"
}