Moondream2

Class: Moondream2BlockV1

Source: inference.core.workflows.core_steps.models.foundation.moondream2.v1.Moondream2BlockV1

This workflow block runs Moondream2, a multimodal vision-language model. You can use this block to run zero-shot object detection.

Type identifier

Use the following identifier in step "type" field: roboflow_core/moondream2@v1to add the block as as step in your workflow.

Properties

Name	Type	Description	Refs
name	str	Enter a unique identifier for this step..	❌
prompt	str	Optional text prompt to provide additional context to Moondream2..	✅
model_version	str	The Moondream2 model to be used for inference..	✅

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections

Compatible Blocks

Check what blocks you can connect to Moondream2 in version v1.

• inputs: Anthropic Claude, Mask Visualization, Classification Label Visualization, Instance Segmentation Model, Webhook Sink, Multi-Label Classification Model, Email Notification, QR Code Generator, Dynamic Crop, VLM As Detector, Google Gemini, LMM, Multi-Label Classification Model, Image Blur, Corner Visualization, Image Convert Grayscale, Stability AI Outpainting, Halo Visualization, Stability AI Inpainting, Object Detection Model, Image Contours, Single-Label Classification Model, Trace Visualization, Google Vision OCR, Morphological Transformation, Triangle Visualization, Instance Segmentation Model, Relative Static Crop, CSV Formatter, Text Display, Stitch Images, Google Gemini, Camera Calibration, Grid Visualization, Local File Sink, Slack Notification, VLM As Classifier, Roboflow Dataset Upload, Camera Focus, Color Visualization, Dot Visualization, Image Slicer, Polygon Visualization, Object Detection Model, Anthropic Claude, LMM For Classification, Line Counter Visualization, Llama 3.2 Vision, Keypoint Detection Model, Contrast Equalization, SIFT Comparison, Camera Focus, Background Subtraction, Image Slicer, Circle Visualization, Halo Visualization, Florence-2 Model, Blur Visualization, Label Visualization, Twilio SMS/MMS Notification, Clip Comparison, Email Notification, Ellipse Visualization, OpenAI, SIFT, Image Preprocessing, Model Monitoring Inference Aggregator, Single-Label Classification Model, OpenAI, Image Threshold, Background Color Visualization, Model Comparison Visualization, Depth Estimation, OpenAI, Keypoint Detection Model, CogVLM, Absolute Static Crop, Roboflow Custom Metadata, EasyOCR, Stitch OCR Detections, Perspective Correction, Anthropic Claude, Pixelate Visualization, Stability AI Image Generation, Reference Path Visualization, Keypoint Visualization, Polygon Visualization, Twilio SMS Notification, Bounding Box Visualization, Polygon Zone Visualization, OCR Model, Icon Visualization, Crop Visualization, Stitch OCR Detections, Google Gemini, OpenAI, Florence-2 Model, Roboflow Dataset Upload
• outputs: Circle Visualization, Detections Consensus, Detections Merge, Florence-2 Model, Blur Visualization, Dynamic Crop, Label Visualization, Path Deviation, Detection Offset, Corner Visualization, Ellipse Visualization, Byte Tracker, Byte Tracker, Line Counter, Model Monitoring Inference Aggregator, Segment Anything 2 Model, Detections List Roll-Up, Model Comparison Visualization, Background Color Visualization, Size Measurement, Trace Visualization, Path Deviation, Time in Zone, Line Counter, Triangle Visualization, Detections Stitch, Detections Filter, Roboflow Custom Metadata, Detections Stabilizer, Roboflow Dataset Upload, PTZ Tracking (ONVIF).md), Stitch OCR Detections, Camera Focus, Perspective Correction, Color Visualization, Detections Combine, Pixelate Visualization, Dot Visualization, Bounding Box Visualization, Detection Event Log, Detections Transformation, Byte Tracker, Distance Measurement, Detections Classes Replacement, Overlap Filter, Icon Visualization, Crop Visualization, Time in Zone, Stitch OCR Detections, Time in Zone, Velocity, Florence-2 Model, Roboflow Dataset Upload

Input and Output Bindings

The available connections depend on its binding kinds. Check what binding kinds Moondream2 in version v1 has.

Bindings

• input

  • images (image): The image to infer on..
  • prompt (string): Optional text prompt to provide additional context to Moondream2..
  • model_version (roboflow_model_id): The Moondream2 model to be used for inference..

• output

  • predictions (object_detection_prediction): Prediction with detected bounding boxes in form of sv.Detections(...) object.

Example JSON definition of step Moondream2 in version v1

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/moondream2@v1",
    "images": "$inputs.image",
    "prompt": "my prompt",
    "model_version": "moondream2/moondream2_2b_jul24"
}