CogVLM¶
Class: CogVLMBlockV1
Source: inference.core.workflows.core_steps.models.foundation.cog_vlm.v1.CogVLMBlockV1
CogVLM reached End Of Life
Due to dependencies conflicts with newer models and security vulnerabilities discovered in transformers
library patched in the versions of library incompatible with the model we announced End Of Life for CogVLM
support in inference, effective since release 0.38.0.
We are leaving this block in ecosystem until release 0.42.0 for clients to get informed about change that
was introduced.
Starting as of now, all Workflows using the block stop being functional (runtime error will be raised),
after inference release 0.42.0 - this block will be removed and Execution Engine will raise compilation
error seeing the block in Workflow definition.
Ask a question to CogVLM, an open source vision-language model.
This model requires a GPU and can only be run on self-hosted devices, and is not available on the Roboflow Hosted API.
This model was previously part of the LMM block.
Type identifier¶
Use the following identifier in step "type" field: roboflow_core/cog_vlm@v1to add the block as
as step in your workflow.
Properties¶
| Name | Type | Description | Refs |
|---|---|---|---|
name |
str |
Enter a unique identifier for this step.. | ❌ |
prompt |
str |
Text prompt to the CogVLM model. | ✅ |
json_output_format |
Dict[str, str] |
Holds dictionary that maps name of requested output field into its description. | ❌ |
The Refs column marks possibility to parametrise the property with dynamic values available
in workflow runtime. See Bindings for more info.
Available Connections¶
Compatible Blocks
Check what blocks you can connect to CogVLM in version v1.
- inputs:
Stitch Images,Image Threshold,Email Notification,Corner Visualization,Image Blur,Ellipse Visualization,OpenAI,Roboflow Dataset Upload,Object Detection Model,Depth Estimation,Stitch OCR Detections,EasyOCR,Absolute Static Crop,CogVLM,Google Gemini,Stability AI Image Generation,Grid Visualization,Dynamic Crop,Image Slicer,Image Preprocessing,Relative Static Crop,SIFT,Morphological Transformation,Instance Segmentation Model,Line Counter Visualization,Trace Visualization,LMM For Classification,Halo Visualization,Dot Visualization,GLM-OCR,Model Monitoring Inference Aggregator,Roboflow Custom Metadata,Pixelate Visualization,Circle Visualization,Image Convert Grayscale,Icon Visualization,QR Code Generator,S3 Sink,Keypoint Detection Model,Twilio SMS Notification,Halo Visualization,Camera Focus,Anthropic Claude,OCR Model,Polygon Visualization,Text Display,Reference Path Visualization,Llama 3.2 Vision,CSV Formatter,Crop Visualization,Roboflow Dataset Upload,Mask Visualization,Heatmap Visualization,Webhook Sink,Label Visualization,Classification Label Visualization,Google Vision OCR,Florence-2 Model,Florence-2 Model,VLM As Detector,Polygon Zone Visualization,Stability AI Inpainting,Google Gemini,Perspective Correction,Camera Calibration,Anthropic Claude,OpenAI,OpenAI,Qwen3.5-VL,Background Color Visualization,Anthropic Claude,Email Notification,Background Subtraction,Contrast Equalization,SIFT Comparison,Multi-Label Classification Model,Keypoint Visualization,Stitch OCR Detections,LMM,Color Visualization,Single-Label Classification Model,OpenAI,Roboflow Vision Events,Local File Sink,VLM As Classifier,Twilio SMS/MMS Notification,Triangle Visualization,Clip Comparison,Blur Visualization,Bounding Box Visualization,Camera Focus,Polygon Visualization,Google Gemini,Image Slicer,Image Contours,Model Comparison Visualization,Stability AI Outpainting,Slack Notification - outputs:
Corner Visualization,Roboflow Dataset Upload,Stitch OCR Detections,Gaze Detection,Time in Zone,Instance Segmentation Model,SIFT,Line Counter Visualization,Detections Combine,Pixelate Visualization,Semantic Segmentation Model,S3 Sink,Detections Classes Replacement,Halo Visualization,SIFT Comparison,OC-SORT Tracker,Cosine Similarity,Qwen3-VL,Roboflow Dataset Upload,Crop Visualization,Mask Visualization,Detection Offset,CLIP Embedding Model,Heatmap Visualization,Cache Set,Google Vision OCR,Detections List Roll-Up,Florence-2 Model,Florence-2 Model,VLM As Classifier,OpenAI,Background Color Visualization,Template Matching,SIFT Comparison,Detections Filter,LMM,Detections Merge,Seg Preview,Motion Detection,Single-Label Classification Model,Dynamic Zone,Object Detection Model,Roboflow Vision Events,Detections Stitch,Triangle Visualization,Expression,Stability AI Outpainting,Stitch Images,Image Blur,Ellipse Visualization,CogVLM,Google Gemini,Continue If,Morphological Transformation,LMM For Classification,Detection Event Log,Dot Visualization,GLM-OCR,Model Monitoring Inference Aggregator,Keypoint Detection Model,Image Convert Grayscale,Icon Visualization,Detections Stabilizer,Camera Focus,Reference Path Visualization,Llama 3.2 Vision,Byte Tracker,Byte Tracker,Classification Label Visualization,Stability AI Inpainting,SAM 3,Perspective Correction,Size Measurement,Email Notification,Single-Label Classification Model,Delta Filter,Line Counter,Local File Sink,Mask Area Measurement,Twilio SMS/MMS Notification,YOLO-World Model,Clip Comparison,Clip Comparison,Bounding Box Visualization,Blur Visualization,VLM As Detector,Slack Notification,Image Threshold,Email Notification,Object Detection Model,Dimension Collapse,Stability AI Image Generation,Grid Visualization,Dynamic Crop,Image Slicer,Image Preprocessing,Trace Visualization,Halo Visualization,ByteTrack Tracker,Cache Get,Roboflow Custom Metadata,Circle Visualization,Keypoint Detection Model,Twilio SMS Notification,Data Aggregator,Anthropic Claude,Detections Consensus,Polygon Visualization,Identify Changes,Webhook Sink,Overlap Filter,Anthropic Claude,VLM As Detector,OpenAI,PTZ Tracking (ONVIF),Bounding Rectangle,Anthropic Claude,Background Subtraction,Multi-Label Classification Model,Keypoint Visualization,Time in Zone,Stitch OCR Detections,Detections Transformation,Identify Outliers,Perception Encoder Embedding Model,SAM 3,VLM As Classifier,Distance Measurement,Google Gemini,Path Deviation,Image Slicer,Image Contours,Model Comparison Visualization,Barcode Detection,OpenAI,Time in Zone,Depth Estimation,EasyOCR,Absolute Static Crop,Multi-Label Classification Model,JSON Parser,Velocity,Relative Static Crop,Pixel Color Count,QR Code Generator,First Non Empty Or Default,SAM 3,OCR Model,Text Display,Qwen2.5-VL,Instance Segmentation Model,CSV Formatter,SORT Tracker,Label Visualization,Segment Anything 2 Model,Polygon Zone Visualization,Google Gemini,Rate Limiter,Camera Calibration,Qwen3.5-VL,Contrast Equalization,Line Counter,Path Deviation,SmolVLM2,Byte Tracker,Property Definition,Color Visualization,OpenAI,Dominant Color,QR Code Detection,Buffer,Camera Focus,Polygon Visualization,Moondream2
Input and Output Bindings¶
The available connections depend on its binding kinds. Check what binding kinds
CogVLM in version v1 has.
Bindings
-
input
-
output
parent_id(parent_id): Identifier of parent for step output.root_parent_id(parent_id): Identifier of parent for step output.image(image_metadata): Dictionary with image metadata required by supervision.structured_output(dictionary): Dictionary.raw_output(string): String value.*(*): Equivalent of any element.
Example JSON definition of step CogVLM in version v1
{
"name": "<your_step_name_here>",
"type": "roboflow_core/cog_vlm@v1",
"images": "$inputs.image",
"prompt": "my prompt",
"json_output_format": {
"count": "number of cats in the picture"
}
}