SmolVLM2¶
Class: SmolVLM2BlockV1
Source: inference.core.workflows.core_steps.models.foundation.smolvlm.v1.SmolVLM2BlockV1
This workflow block runs SmolVLM2, a multimodal vision-language model. You can ask questions about images -- including documents and photos -- and get answers in natural language.
Type identifier¶
Use the following identifier in step "type" field: roboflow_core/smolvlm2@v1to add the block as
as step in your workflow.
Properties¶
| Name | Type | Description | Refs |
|---|---|---|---|
name |
str |
Enter a unique identifier for this step.. | ❌ |
prompt |
str |
Optional text prompt to provide additional context to SmolVLM2. Otherwise it will just be None. | ❌ |
model_version |
str |
The SmolVLM2 model to be used for inference.. | ✅ |
The Refs column marks possibility to parametrise the property with dynamic values available
in workflow runtime. See Bindings for more info.
Runtime compatibility¶
-
hard— runtimeself_hosted_cpu; executionlocal - Requires a GPU; run_locally() loads a model that needs CUDA.
Available Connections¶
Compatible Blocks
Check what blocks you can connect to SmolVLM2 in version v1.
- inputs:
Halo Visualization,Polygon Visualization,Multi-Label Classification Model,Mask Visualization,Image Threshold,Stability AI Inpainting,Stitch Images,Classification Label Visualization,Morphological Transformation,Crop Visualization,Icon Visualization,Stability AI Outpainting,Blur Visualization,Reference Path Visualization,Single-Label Classification Model,Keypoint Visualization,Single-Label Classification Model,Background Subtraction,Camera Focus,Instance Segmentation Model,QR Code Generator,Instance Segmentation Model,Pixelate Visualization,Model Comparison Visualization,Semantic Segmentation Model,Trace Visualization,Image Slicer,Ellipse Visualization,Object Detection Model,Image Contours,Line Counter Visualization,Keypoint Detection Model,Dot Visualization,Perspective Correction,Image Preprocessing,Image Convert Grayscale,Label Visualization,Dynamic Crop,Instance Segmentation Model,Semantic Segmentation Model,Text Display,Depth Estimation,Bounding Box Visualization,Image Blur,Absolute Static Crop,SIFT,Keypoint Detection Model,Corner Visualization,Polygon Zone Visualization,Camera Calibration,Grid Visualization,Stability AI Image Generation,Triangle Visualization,Camera Focus,Contrast Equalization,Circle Visualization,Polygon Visualization,Image Slicer,Relative Static Crop,Heatmap Visualization,Multi-Label Classification Model,Object Detection Model,Contrast Enhancement,Halo Visualization,Color Visualization,Morphological Transformation,SIFT Comparison,Background Color Visualization - outputs:
Microsoft SQL Server Sink,PLC EthernetIP,Detections Consensus,Roboflow Asset Library Attributes,SAM 3,Per-Class Confidence Filter
Input and Output Bindings¶
The available connections depend on its binding kinds. Check what binding kinds
SmolVLM2 in version v1 has.
Bindings
-
input
images(image): The image to infer on..model_version(roboflow_model_id): The SmolVLM2 model to be used for inference..
-
output
parsed_output(dictionary): Dictionary.
Example JSON definition of step SmolVLM2 in version v1
{
"name": "<your_step_name_here>",
"type": "roboflow_core/smolvlm2@v1",
"images": "$inputs.image",
"prompt": "What is in this image?",
"model_version": "smolvlm2/smolvlm-2.2b-instruct"
}