SmolVLM2¶
Class: SmolVLM2BlockV1
Source: inference.core.workflows.core_steps.models.foundation.smolvlm.v1.SmolVLM2BlockV1
This workflow block runs SmolVLM2, a multimodal vision-language model. You can ask questions about images -- including documents and photos -- and get answers in natural language.
Type identifier¶
Use the following identifier in step "type" field: roboflow_core/smolvlm2@v1to add the block as
as step in your workflow.
Properties¶
| Name | Type | Description | Refs |
|---|---|---|---|
name |
str |
Enter a unique identifier for this step.. | ❌ |
prompt |
str |
Optional text prompt to provide additional context to SmolVLM2. Otherwise it will just be None. | ❌ |
model_version |
str |
The SmolVLM2 model to be used for inference.. | ✅ |
The Refs column marks possibility to parametrise the property with dynamic values available
in workflow runtime. See Bindings for more info.
Runtime compatibility¶
-
hard— runtimeself_hosted_cpu; executionlocal - Requires a GPU; run_locally() loads a model that needs CUDA.
Available Connections¶
Compatible Blocks
Check what blocks you can connect to SmolVLM2 in version v1.
- inputs:
Halo Visualization,Trace Visualization,Polygon Visualization,Image Preprocessing,Single-Label Classification Model,Camera Focus,Corner Visualization,Ellipse Visualization,Dynamic Crop,Crop Visualization,Image Slicer,Morphological Transformation,Bounding Box Visualization,Keypoint Detection Model,Roboflow Visual Search,Icon Visualization,Heatmap Visualization,Object Detection Model,Single-Label Classification Model,Color Visualization,Halo Visualization,Multi-Label Classification Model,Mask Visualization,Instance Segmentation Model,Absolute Static Crop,Pixelate Visualization,Image Blur,Triangle Visualization,Background Color Visualization,Dot Visualization,Grid Visualization,SIFT Comparison,Object Detection Model,Image Contours,Image Threshold,Blur Visualization,Stitch Images,Instance Segmentation Model,Roboflow Visual Search Classifier,Stability AI Inpainting,QR Code Generator,Reference Path Visualization,Semantic Segmentation Model,Polygon Zone Visualization,Keypoint Visualization,Classification Label Visualization,Perspective Correction,Background Subtraction,Camera Focus,Image Convert Grayscale,Label Visualization,Contrast Equalization,Polygon Visualization,Auto Rotate on Edges,SIFT,Stability AI Image Generation,Text Display,Image Slicer,Instance Segmentation Model,Circle Visualization,Model Comparison Visualization,Stability AI Outpainting,Keypoint Detection Model,Line Counter Visualization,Camera Calibration,Multi-Label Classification Model,Contrast Enhancement,Relative Static Crop,Semantic Segmentation Model,Depth Estimation,Morphological Transformation - outputs:
Per-Class Confidence Filter,SAM 3,Detections Consensus,Roboflow Asset Library Attributes,PLC EthernetIP,Microsoft SQL Server Sink
Input and Output Bindings¶
The available connections depend on its binding kinds. Check what binding kinds
SmolVLM2 in version v1 has.
Bindings
-
input
images(image): The image to infer on..model_version(roboflow_model_id): The SmolVLM2 model to be used for inference..
-
output
parsed_output(dictionary): Dictionary.
Example JSON definition of step SmolVLM2 in version v1
{
"name": "<your_step_name_here>",
"type": "roboflow_core/smolvlm2@v1",
"images": "$inputs.image",
"prompt": "What is in this image?",
"model_version": "smolvlm2/smolvlm-2.2b-instruct"
}