LMM For Classification¶
Deprecated
This block is deprecated and may be removed in a future release.
Class: LMMForClassificationBlockV1
Source: inference.core.workflows.core_steps.models.foundation.lmm_classifier.v1.LMMForClassificationBlockV1
Classify an image into one or more categories using a Large Multimodal Model (LMM).
You can specify arbitrary classes to an LMMBlock.
The LLMBlock supports two LMMs:
- OpenAI's GPT-4 with Vision.
You need to provide your OpenAI API key to use the GPT-4 with Vision model.
Type identifier¶
Use the following identifier in step "type" field: roboflow_core/lmm_for_classification@v1to add the block as
as step in your workflow.
Properties¶
| Name | Type | Description | Refs |
|---|---|---|---|
name |
str |
Enter a unique identifier for this step.. | ❌ |
lmm_type |
str |
Type of LMM to be used. | ✅ |
classes |
List[str] |
List of classes that LMM shall classify against. | ✅ |
lmm_config |
LMMConfig |
Configuration of LMM. | ❌ |
remote_api_key |
str |
Holds API key required to call LMM model - in current state of development, we require OpenAI key when lmm_type=gpt_4v.. |
✅ |
The Refs column marks possibility to parametrise the property with dynamic values available
in workflow runtime. See Bindings for more info.
Available Connections¶
Compatible Blocks
Check what blocks you can connect to LMM For Classification in version v1.
- inputs:
Anthropic Claude,Instance Segmentation Model,Google Vision OCR,Circle Visualization,Image Slicer,Google Gemini,Image Contours,Qwen 3.6 API,Single-Label Classification Model,Roboflow Vision Events,Depth Estimation,Line Counter Visualization,Stitch Images,Morphological Transformation,LMM,Model Comparison Visualization,Buffer,MoonshotAI Kimi,Grid Visualization,Twilio SMS/MMS Notification,OpenAI,Clip Comparison,Twilio SMS Notification,Qwen-VL,S3 Sink,Halo Visualization,Camera Focus,SIFT Comparison,Keypoint Detection Model,Local File Sink,Mask Visualization,SIFT,Anthropic Claude,MoonshotAI Kimi,Roboflow Dataset Upload,Text Display,Image Slicer,Multi-Label Classification Model,Absolute Static Crop,Llama 3.2 Vision,GLM-OCR,Object Detection Model,Roboflow Custom Metadata,Email Notification,Dynamic Crop,OpenRouter,Model Monitoring Inference Aggregator,Contrast Enhancement,Motion Detection,Webhook Sink,Google Gemma API,Stability AI Image Generation,Color Visualization,Heatmap Visualization,Contrast Equalization,Google Gemini,Roboflow Dataset Upload,Slack Notification,Anthropic Claude,QR Code Generator,Clip Comparison,OpenAI,Bounding Box Visualization,Florence-2 Model,VLM As Classifier,Image Blur,Dot Visualization,Polygon Zone Visualization,Label Visualization,Icon Visualization,Image Threshold,LMM For Classification,Blur Visualization,Relative Static Crop,Dimension Collapse,Trace Visualization,Qwen3.5-VL,Size Measurement,Dynamic Zone,Florence-2 Model,Camera Focus,CogVLM,Pixelate Visualization,Llama 3.2 Vision,Image Convert Grayscale,Keypoint Visualization,Polygon Visualization,Google Gemma,Classification Label Visualization,Image Stack,Morphological Transformation,Camera Calibration,Google Gemini,Email Notification,Image Preprocessing,Corner Visualization,Stitch OCR Detections,Halo Visualization,Roboflow Asset Library Attributes,Reference Path Visualization,OpenAI,Background Color Visualization,Ellipse Visualization,CSV Formatter,Stability AI Outpainting,VLM As Detector,EasyOCR,Triangle Visualization,OCR Model,Crop Visualization,Perspective Correction,Qwen 3.5 API,Stitch OCR Detections,OpenAI-Compatible LLM,Detections List Roll-Up,Polygon Visualization,Background Subtraction,OpenAI,Stability AI Inpainting - outputs:
Slack Notification,Anthropic Claude,QR Code Generator,Distance Measurement,Clip Comparison,Instance Segmentation Model,Anthropic Claude,OpenAI,Google Vision OCR,Circle Visualization,Bounding Box Visualization,SAM 3,Florence-2 Model,Google Gemini,Image Blur,Keypoint Detection Model,Qwen 3.6 API,Dot Visualization,Polygon Zone Visualization,Label Visualization,CLIP Embedding Model,Icon Visualization,Image Threshold,Roboflow Vision Events,Cache Get,LMM For Classification,Depth Estimation,Line Counter Visualization,Object Detection Model,Line Counter,Morphological Transformation,LMM,Model Comparison Visualization,Trace Visualization,Moondream2,Size Measurement,Perception Encoder Embedding Model,MoonshotAI Kimi,Segment Anything 2 Model,Florence-2 Model,CogVLM,Cache Set,Instance Segmentation Model,Twilio SMS/MMS Notification,OpenAI,Detections Classes Replacement,Llama 3.2 Vision,Time in Zone,Keypoint Visualization,Twilio SMS Notification,SAM 3,Polygon Visualization,Qwen-VL,S3 Sink,SAM 3,Halo Visualization,Local File Sink,Semantic Segmentation Model,SIFT Comparison,Multi-Label Classification Model,Line Counter,Google Gemma,Classification Label Visualization,Mask Visualization,Morphological Transformation,Email Notification,Google Gemini,Path Deviation,Anthropic Claude,MoonshotAI Kimi,Roboflow Dataset Upload,Image Preprocessing,Text Display,Corner Visualization,Stitch OCR Detections,Llama 3.2 Vision,Halo Visualization,PTZ Tracking (ONVIF),Path Deviation,GLM-OCR,Roboflow Asset Library Attributes,Email Notification,Seg Preview,Dynamic Crop,Roboflow Custom Metadata,OpenAI,Instance Segmentation Model,Reference Path Visualization,Time in Zone,OpenRouter,Detections Stitch,Background Color Visualization,Single-Label Classification Model,Model Monitoring Inference Aggregator,Ellipse Visualization,Stability AI Outpainting,Triangle Visualization,Crop Visualization,Webhook Sink,Google Gemma API,Qwen 3.5 API,Perspective Correction,Stability AI Image Generation,Stitch OCR Detections,OpenAI-Compatible LLM,Color Visualization,Heatmap Visualization,Contrast Equalization,Instance Segmentation Model,Time in Zone,YOLO-World Model,Polygon Visualization,Pixel Color Count,Google Gemini,Roboflow Dataset Upload,OpenAI,Stability AI Inpainting
Input and Output Bindings¶
The available connections depend on its binding kinds. Check what binding kinds
LMM For Classification in version v1 has.
Bindings
-
input
images(image): The image to infer on..lmm_type(string): Type of LMM to be used.classes(list_of_values): List of classes that LMM shall classify against.remote_api_key(Union[secret,string]): Holds API key required to call LMM model - in current state of development, we require OpenAI key whenlmm_type=gpt_4v..
-
output
raw_output(string): String value.top(top_class): String value representing top class predicted by classification model.parent_id(parent_id): Identifier of parent for step output.root_parent_id(parent_id): Identifier of parent for step output.image(image_metadata): Dictionary with image metadata required by supervision.prediction_type(prediction_type): String value with type of prediction.
Example JSON definition of step LMM For Classification in version v1
{
"name": "<your_step_name_here>",
"type": "roboflow_core/lmm_for_classification@v1",
"images": "$inputs.image",
"lmm_type": "gpt_4v",
"classes": [
"a",
"b"
],
"lmm_config": {
"gpt_image_detail": "low",
"gpt_model_version": "gpt-4o",
"max_tokens": 200
},
"remote_api_key": "xxx-xxx"
}