SmolVLM2¶
Class: SmolVLM2BlockV1
Source: inference.core.workflows.core_steps.models.foundation.smolvlm.v1.SmolVLM2BlockV1
This workflow block runs SmolVLM2, a multimodal vision-language model. You can ask questions about images -- including documents and photos -- and get answers in natural language.
Type identifier¶
Use the following identifier in step "type" field: roboflow_core/smolvlm2@v1to add the block as
as step in your workflow.
Properties¶
| Name | Type | Description | Refs |
|---|---|---|---|
name |
str |
Enter a unique identifier for this step.. | ❌ |
prompt |
str |
Optional text prompt to provide additional context to SmolVLM2. Otherwise it will just be None. | ❌ |
model_version |
str |
The SmolVLM2 model to be used for inference.. | ✅ |
The Refs column marks possibility to parametrise the property with dynamic values available
in workflow runtime. See Bindings for more info.
Runtime compatibility¶
-
hard— runtimeself_hosted_cpu; executionlocal - Requires a GPU; run_locally() loads a model that needs CUDA.
Available Connections¶
Compatible Blocks
Check what blocks you can connect to SmolVLM2 in version v1.
- inputs:
Heatmap Visualization,Image Slicer,Polygon Zone Visualization,Contrast Enhancement,Semantic Segmentation Model,Stability AI Image Generation,Image Threshold,Line Counter Visualization,Trace Visualization,Semantic Segmentation Model,Multi-Label Classification Model,Blur Visualization,Object Detection Model,Camera Calibration,Depth Estimation,QR Code Generator,Stability AI Outpainting,Icon Visualization,SIFT Comparison,Morphological Transformation,Background Subtraction,Keypoint Visualization,Color Visualization,Single-Label Classification Model,Perspective Correction,Bounding Box Visualization,Corner Visualization,Stitch Images,Halo Visualization,Image Blur,Image Convert Grayscale,Morphological Transformation,Keypoint Detection Model,Camera Focus,Instance Segmentation Model,Contrast Equalization,Halo Visualization,Stability AI Inpainting,Object Detection Model,Roboflow Visual Search,Classification Label Visualization,Triangle Visualization,Instance Segmentation Model,Grid Visualization,Background Color Visualization,Mask Visualization,Ellipse Visualization,Pixelate Visualization,Keypoint Detection Model,Instance Segmentation Model,Reference Path Visualization,SIFT,Label Visualization,Image Slicer,Text Display,Multi-Label Classification Model,Dot Visualization,Polygon Visualization,Crop Visualization,Dynamic Crop,Absolute Static Crop,Circle Visualization,Image Contours,Image Preprocessing,Polygon Visualization,Relative Static Crop,Camera Focus,Model Comparison Visualization,Single-Label Classification Model - outputs:
PLC EthernetIP,SAM 3,Detections Consensus,Per-Class Confidence Filter,Microsoft SQL Server Sink,Roboflow Asset Library Attributes
Input and Output Bindings¶
The available connections depend on its binding kinds. Check what binding kinds
SmolVLM2 in version v1 has.
Bindings
-
input
images(image): The image to infer on..model_version(roboflow_model_id): The SmolVLM2 model to be used for inference..
-
output
parsed_output(dictionary): Dictionary.
Example JSON definition of step SmolVLM2 in version v1
{
"name": "<your_step_name_here>",
"type": "roboflow_core/smolvlm2@v1",
"images": "$inputs.image",
"prompt": "What is in this image?",
"model_version": "smolvlm2/smolvlm-2.2b-instruct"
}