Detections Classes Replacement

Class: DetectionsClassesReplacementBlockV1

Source: inference.core.workflows.core_steps.fusion.detections_classes_replacement.v1.DetectionsClassesReplacementBlockV1

Combine results of detection model with classification results performed separately for each and every bounding box.

Bounding boxes without top class predicted by classification model are discarded, for multi-label classification results, most confident label is taken as bounding box class.

Type identifier

Use the following identifier in step "type" field: roboflow_core/detections_classes_replacement@v1to add the block as as step in your workflow.

Properties

Name	Type	Description	Refs
name	str	Enter a unique identifier for this step..	❌
fallback_class_name	str	The class name to be used as a fallback if no class is predicted for a bounding box.	✅
fallback_class_id	int	The class id to be used as a fallback if no class is predicted for a bounding box;if not specified or negative, the class id will be set to 9223372036854775807.	✅

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections

Compatible Blocks

Check what blocks you can connect to Detections Classes Replacement in version v1.

• inputs: YOLO-World Model, VLM as Detector, OpenAI, Bounding Rectangle, Keypoint Detection Model, Detections Classes Replacement, Google Gemini, OpenAI, Roboflow Dataset Upload, Gaze Detection, PTZ Tracking (ONVIF).md), Roboflow Custom Metadata, Detections Transformation, Single-Label Classification Model, Florence-2 Model, Detections Stabilizer, Detections Merge, Distance Measurement, Single-Label Classification Model, CogVLM, Template Matching, Detections Stitch, Dynamic Zone, LMM, Email Notification, Object Detection Model, Instance Segmentation Model, Slack Notification, Byte Tracker, CSV Formatter, Detections Consensus, Overlap Filter, Object Detection Model, Detections Filter, Perspective Correction, Google Vision OCR, Path Deviation, Detection Offset, Model Monitoring Inference Aggregator, OpenAI, Pixel Color Count, Keypoint Detection Model, Stitch OCR Detections, VLM as Classifier, Clip Comparison, SIFT Comparison, Dynamic Crop, Moondream2, Time in Zone, Webhook Sink, Florence-2 Model, Segment Anything 2 Model, Twilio SMS Notification, Image Contours, Llama 3.2 Vision, Byte Tracker, Roboflow Dataset Upload, SIFT Comparison, Line Counter, Byte Tracker, Time in Zone, Path Deviation, Local File Sink, VLM as Classifier, Instance Segmentation Model, Anthropic Claude, LMM For Classification, Line Counter, Multi-Label Classification Model, OCR Model, Velocity, Multi-Label Classification Model, VLM as Detector
• outputs: Bounding Rectangle, Corner Visualization, Detections Classes Replacement, Roboflow Dataset Upload, Circle Visualization, PTZ Tracking (ONVIF).md), Triangle Visualization, Roboflow Custom Metadata, Stability AI Inpainting, Detections Transformation, Bounding Box Visualization, Size Measurement, Florence-2 Model, Distance Measurement, Detections Stabilizer, Detections Merge, Halo Visualization, Detections Stitch, Dynamic Zone, Polygon Visualization, Ellipse Visualization, Byte Tracker, Color Visualization, Label Visualization, Dot Visualization, Detections Consensus, Crop Visualization, Overlap Filter, Detections Filter, Perspective Correction, Path Deviation, Model Monitoring Inference Aggregator, Detection Offset, Stitch OCR Detections, Model Comparison Visualization, Dynamic Crop, Mask Visualization, Time in Zone, Florence-2 Model, Segment Anything 2 Model, Pixelate Visualization, Byte Tracker, Roboflow Dataset Upload, Line Counter, Byte Tracker, Time in Zone, Path Deviation, Background Color Visualization, Line Counter, Keypoint Visualization, Blur Visualization, Velocity, Trace Visualization

Input and Output Bindings

The available connections depend on its binding kinds. Check what binding kinds Detections Classes Replacement in version v1 has.

Bindings

• input

  • object_detection_predictions (Union[object_detection_prediction, keypoint_detection_prediction, instance_segmentation_prediction]): The output of a detection model describing the bounding boxes that will have classes replaced..
  • classification_predictions (classification_prediction): The output of classification model for crops taken based on RoIs pointed as the other parameter.
  • fallback_class_name (string): The class name to be used as a fallback if no class is predicted for a bounding box.
  • fallback_class_id (integer): The class id to be used as a fallback if no class is predicted for a bounding box;if not specified or negative, the class id will be set to 9223372036854775807.

• output

  • predictions (Union[object_detection_prediction, instance_segmentation_prediction, keypoint_detection_prediction]): Prediction with detected bounding boxes in form of sv.Detections(...) object if object_detection_prediction or Prediction with detected bounding boxes and segmentation masks in form of sv.Detections(...) object if instance_segmentation_prediction or Prediction with detected bounding boxes and detected keypoints in form of sv.Detections(...) object if keypoint_detection_prediction.

Example JSON definition of step Detections Classes Replacement in version v1

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/detections_classes_replacement@v1",
    "object_detection_predictions": "$steps.my_object_detection_model.predictions",
    "classification_predictions": "$steps.my_classification_model.predictions",
    "fallback_class_name": "unknown",
    "fallback_class_id": 77
}