LMM For Classification¶
Deprecated
This block is deprecated and may be removed in a future release.
Class: LMMForClassificationBlockV1
Source: inference.core.workflows.core_steps.models.foundation.lmm_classifier.v1.LMMForClassificationBlockV1
Classify an image into one or more categories using a Large Multimodal Model (LMM).
You can specify arbitrary classes to an LMMBlock.
The LLMBlock supports two LMMs:
- OpenAI's GPT-4 with Vision.
You need to provide your OpenAI API key to use the GPT-4 with Vision model.
Type identifier¶
Use the following identifier in step "type" field: roboflow_core/lmm_for_classification@v1to add the block as
as step in your workflow.
Properties¶
| Name | Type | Description | Refs |
|---|---|---|---|
name |
str |
Enter a unique identifier for this step.. | ❌ |
lmm_type |
str |
Type of LMM to be used. | ✅ |
classes |
List[str] |
List of classes that LMM shall classify against. | ✅ |
lmm_config |
LMMConfig |
Configuration of LMM. | ❌ |
remote_api_key |
str |
Holds API key required to call LMM model - in current state of development, we require OpenAI key when lmm_type=gpt_4v.. |
✅ |
The Refs column marks possibility to parametrise the property with dynamic values available
in workflow runtime. See Bindings for more info.
Runtime compatibility¶
-
requires_internet— air-gapped / offline deployments - This block depends on a service that is not reachable from fully offline / air-gapped deployments.
-
hard— runtimehosted_serverless; executionremote - LMM_ENABLED=False on Roboflow Hosted Serverless: the /llm_v1 endpoint is not registered, so run_remotely() returns 404.
Available Connections¶
Compatible Blocks
Check what blocks you can connect to LMM For Classification in version v1.
- inputs:
PLC Writer,Image Blur,Crop Visualization,Polygon Visualization,Roboflow Visual Search Classifier,Image Slicer,Qwen3.5-VL,Image Convert Grayscale,Webhook Sink,VLM As Classifier,Motion Detection,Clip Comparison,Buffer,SIFT,Slack Notification,Label Visualization,MoonshotAI Kimi,Stitch OCR Detections,Label Visualization,S3 Sink,Email Notification,Background Subtraction,Ellipse Visualization,Stitch Images,OPC UA Writer Sink,CSV Formatter,Corner Visualization,Triangle Visualization,Qwen-VL,Camera Calibration,Google Gemini,Polygon Zone Visualization,Roboflow Custom Metadata,LMM For Classification,Camera Focus,PP-OCR,SIFT Comparison,Trace Visualization,Color Visualization,Local File Sink,Llama 3.2 Vision,Llama 3.2 Vision,Morphological Transformation,Dynamic Zone,Google Vision OCR,Google Gemma API,Google Gemma,Microsoft SQL Server Sink,Polygon Visualization,Icon Visualization,PLC ModbusTCP,Rich Label Visualization,Twilio SMS/MMS Notification,Keypoint Visualization,Image Slicer,OpenAI,Clip Comparison,OpenAI,Keypoint Detection Model,Object Detection Model,Qwen 3.6 API,Instance Segmentation Model,Single-Label Classification Model,Mask Visualization,OpenAI,OpenAI-Compatible LLM,Roboflow Visual Search,VLM As Detector,Stability AI Outpainting,Blur Visualization,Bounding Box Visualization,Absolute Static Crop,Roboflow Dataset Upload,Reference Path Visualization,OpenAI,Anthropic Claude,Google Gemini,Event Writer,Stitch OCR Detections,CogVLM,Email Notification,Contrast Enhancement,Current Time,Perspective Correction,Detections List Roll-Up,Halo Visualization,Dimension Collapse,Multi-Label Classification Model,Dynamic Crop,OpenRouter,PLC EthernetIP,OCR Model,GeoTag Detection,Halo Visualization,Line Counter Visualization,Roboflow Asset Library Attributes,Size Measurement,LMM,Relative Static Crop,Depth Estimation,Dot Visualization,GLM-OCR,Florence-2 Model,EasyOCR,Background Color Visualization,Google Gemini,Image Contours,Roboflow Dataset Upload,Qwen 3.5 API,MoonshotAI Kimi,Stability AI Inpainting,Contrast Equalization,Morphological Transformation,Image Threshold,Camera Focus,Stability AI Image Generation,Circle Visualization,QR Code Generator,Google Gemini,Model Monitoring Inference Aggregator,Roboflow Vision Events,Heatmap Visualization,Twilio SMS Notification,Auto Rotate on Edges,Cosmos 3,MQTT Writer,Anthropic Claude,Image Preprocessing,Anthropic Claude,Text Display,Image Stack,Grid Visualization,Model Comparison Visualization,Florence-2 Model,Classification Label Visualization,Pixelate Visualization - outputs:
Image Blur,Path Deviation,Crop Visualization,Polygon Visualization,Object Detection Model,Roboflow Visual Search Classifier,Qwen3.5-VL,CLIP Embedding Model,Webhook Sink,YOLO-World Model,Slack Notification,Label Visualization,MoonshotAI Kimi,Stitch OCR Detections,Label Visualization,Instance Segmentation Model,S3 Sink,Perception Encoder Embedding Model,Email Notification,Keypoint Detection Model,Pixel Color Count,Single-Label Classification Model,OPC UA Writer Sink,Ellipse Visualization,Path Deviation,Corner Visualization,Triangle Visualization,Qwen-VL,Distance Measurement,Google Gemini,Seg Preview,Polygon Zone Visualization,Roboflow Custom Metadata,LMM For Classification,Trace Visualization,SIFT Comparison,Color Visualization,Local File Sink,Llama 3.2 Vision,SAM3 Video Tracker,Llama 3.2 Vision,Morphological Transformation,Google Vision OCR,Google Gemma API,Google Gemma,Microsoft SQL Server Sink,Polygon Visualization,Icon Visualization,Rich Label Visualization,Twilio SMS/MMS Notification,Keypoint Visualization,OpenAI,OpenAI,Clip Comparison,Qwen 3.6 API,Instance Segmentation Model,Mask Visualization,Moondream2,Nearest Neighbor Detection Match,OpenAI,OpenAI-Compatible LLM,Instance Segmentation Model,Roboflow Visual Search,Stability AI Outpainting,Bounding Box Visualization,Roboflow Dataset Upload,OpenAI,Anthropic Claude,Reference Path Visualization,Google Gemini,Detections Stitch,Event Writer,Cache Set,Stitch OCR Detections,CogVLM,Time in Zone,Email Notification,Current Time,Perspective Correction,Halo Visualization,Semantic Segmentation Model,Cache Get,OpenRouter,Dynamic Crop,Halo Visualization,Line Counter Visualization,Time in Zone,Time in Zone,Roboflow Asset Library Attributes,Multi-Label Classification Model,Size Measurement,LMM,Depth Estimation,SAM 3,Dot Visualization,GLM-OCR,Florence-2 Model,Google Gemini,Background Color Visualization,Roboflow Dataset Upload,Qwen 3.5 API,Segment Anything 2 Model,MoonshotAI Kimi,Stability AI Inpainting,Contrast Equalization,Morphological Transformation,Image Threshold,SAM 3,Line Counter,Stability AI Image Generation,Instance Segmentation Model,Circle Visualization,QR Code Generator,Google Gemini,Detections Classes Replacement,Roboflow Vision Events,Model Monitoring Inference Aggregator,Twilio SMS Notification,Heatmap Visualization,Cosmos 3,Auto Rotate on Edges,MQTT Writer,SAM 3,Anthropic Claude,Image Preprocessing,Line Counter,Anthropic Claude,Text Display,PTZ Tracking (ONVIF),Model Comparison Visualization,Florence-2 Model,Classification Label Visualization
Input and Output Bindings¶
The available connections depend on its binding kinds. Check what binding kinds
LMM For Classification in version v1 has.
Bindings
-
input
images(image): The image to infer on..lmm_type(string): Type of LMM to be used.classes(list_of_values): List of classes that LMM shall classify against.remote_api_key(Union[string,secret]): Holds API key required to call LMM model - in current state of development, we require OpenAI key whenlmm_type=gpt_4v..
-
output
raw_output(string): String value.top(top_class): String value representing top class predicted by classification model.parent_id(parent_id): Identifier of parent for step output.root_parent_id(parent_id): Identifier of parent for step output.image(image_metadata): Dictionary with image metadata required by supervision.prediction_type(prediction_type): String value with type of prediction.
Example JSON definition of step LMM For Classification in version v1
{
"name": "<your_step_name_here>",
"type": "roboflow_core/lmm_for_classification@v1",
"images": "$inputs.image",
"lmm_type": "gpt_4v",
"classes": [
"a",
"b"
],
"lmm_config": {
"gpt_image_detail": "low",
"gpt_model_version": "gpt-4o",
"max_tokens": 200
},
"remote_api_key": "xxx-xxx"
}