Detections Classes Replacement

Class: DetectionsClassesReplacementBlockV1

Source: inference.core.workflows.core_steps.fusion.detections_classes_replacement.v1.DetectionsClassesReplacementBlockV1

Combine results of detection model with classification results performed separately for each and every bounding box.

Bounding boxes without top class predicted by classification model are discarded, for multi-label classification results, most confident label is taken as bounding box class.

Type identifier

Use the following identifier in step "type" field: roboflow_core/detections_classes_replacement@v1to add the block as as step in your workflow.

Properties

Name	Type	Description	Refs
name	str	Enter a unique identifier for this step..	❌
fallback_class_name	str	The class name to be used as a fallback if no class is predicted for a bounding box.	✅
fallback_class_id	int	The class id to be used as a fallback if no class is predicted for a bounding box;if not specified or negative, the class id will be set to 9223372036854775807.	✅

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections

Compatible Blocks

Check what blocks you can connect to Detections Classes Replacement in version v1.

• inputs: LMM, Dynamic Zone, VLM as Classifier, Detections Transformation, Model Monitoring Inference Aggregator, Detections Classes Replacement, Object Detection Model, Line Counter, Local File Sink, Keypoint Detection Model, Email Notification, Time in Zone, Anthropic Claude, Google Gemini, Florence-2 Model, Multi-Label Classification Model, Segment Anything 2 Model, OCR Model, Byte Tracker, Time in Zone, Pixel Color Count, Roboflow Custom Metadata, Florence-2 Model, LMM For Classification, Single-Label Classification Model, Overlap Filter, Detection Offset, Perspective Correction, Google Vision OCR, EasyOCR, Llama 3.2 Vision, Line Counter, Detections Stabilizer, SAM 3, Slack Notification, Velocity, Clip Comparison, Stitch OCR Detections, Byte Tracker, OpenAI, Roboflow Dataset Upload, Path Deviation, Template Matching, Distance Measurement, CogVLM, Email Notification, VLM as Detector, Instance Segmentation Model, Byte Tracker, OpenAI, Detections Stitch, Keypoint Detection Model, Object Detection Model, YOLO-World Model, Detections Merge, Gaze Detection, Moondream2, Multi-Label Classification Model, Seg Preview, Path Deviation, Roboflow Dataset Upload, Image Contours, Instance Segmentation Model, Detections Filter, OpenAI, VLM as Classifier, Bounding Rectangle, CSV Formatter, Time in Zone, Detections Combine, Twilio SMS Notification, SIFT Comparison, VLM as Detector, Webhook Sink, Detections Consensus, Single-Label Classification Model, PTZ Tracking (ONVIF).md), Dynamic Crop, SIFT Comparison
• outputs: Polygon Visualization, Roboflow Dataset Upload, Background Color Visualization, Size Measurement, Dynamic Zone, Path Deviation, Detections Transformation, Corner Visualization, Model Monitoring Inference Aggregator, Detections Classes Replacement, Distance Measurement, Trace Visualization, Mask Visualization, Line Counter, Bounding Box Visualization, Model Comparison Visualization, Byte Tracker, Pixelate Visualization, Time in Zone, Florence-2 Model, Detections Stitch, Ellipse Visualization, Triangle Visualization, Segment Anything 2 Model, Crop Visualization, Detections Merge, Icon Visualization, Byte Tracker, Color Visualization, Roboflow Dataset Upload, Path Deviation, Label Visualization, Time in Zone, Keypoint Visualization, Roboflow Custom Metadata, Florence-2 Model, Blur Visualization, Dot Visualization, Overlap Filter, Detections Filter, Circle Visualization, Detection Offset, Bounding Rectangle, Line Counter, Detections Stabilizer, Detections Combine, Time in Zone, Dynamic Crop, Velocity, Detections Consensus, Stitch OCR Detections, Byte Tracker, PTZ Tracking (ONVIF).md), Halo Visualization, Stability AI Inpainting, Perspective Correction

Input and Output Bindings

The available connections depend on its binding kinds. Check what binding kinds Detections Classes Replacement in version v1 has.

Bindings

• input

  • object_detection_predictions (Union[instance_segmentation_prediction, keypoint_detection_prediction, object_detection_prediction]): The output of a detection model describing the bounding boxes that will have classes replaced..
  • classification_predictions (classification_prediction): The output of classification model for crops taken based on RoIs pointed as the other parameter.
  • fallback_class_name (string): The class name to be used as a fallback if no class is predicted for a bounding box.
  • fallback_class_id (integer): The class id to be used as a fallback if no class is predicted for a bounding box;if not specified or negative, the class id will be set to 9223372036854775807.

• output

  • predictions (Union[object_detection_prediction, instance_segmentation_prediction, keypoint_detection_prediction]): Prediction with detected bounding boxes in form of sv.Detections(...) object if object_detection_prediction or Prediction with detected bounding boxes and segmentation masks in form of sv.Detections(...) object if instance_segmentation_prediction or Prediction with detected bounding boxes and detected keypoints in form of sv.Detections(...) object if keypoint_detection_prediction.

Example JSON definition of step Detections Classes Replacement in version v1

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/detections_classes_replacement@v1",
    "object_detection_predictions": "$steps.my_object_detection_model.predictions",
    "classification_predictions": "$steps.my_classification_model.predictions",
    "fallback_class_name": "unknown",
    "fallback_class_id": 77
}