Detections Classes Replacement

Class: DetectionsClassesReplacementBlockV1

Source: inference.core.workflows.core_steps.fusion.detections_classes_replacement.v1.DetectionsClassesReplacementBlockV1

Combine results of detection model with classification results performed separately for each and every bounding box.

Bounding boxes without top class predicted by classification model are discarded, for multi-label classification results, most confident label is taken as bounding box class.

Type identifier

Use the following identifier in step "type" field: roboflow_core/detections_classes_replacement@v1to add the block as as step in your workflow.

Properties

Name	Type	Description	Refs
name	str	Enter a unique identifier for this step..	❌
fallback_class_name	str	The class name to be used as a fallback if no class is predicted for a bounding box.	✅
fallback_class_id	int	The class id to be used as a fallback if no class is predicted for a bounding box;if not specified or negative, the class id will be set to 9223372036854775807.	✅

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections

Compatible Blocks

Check what blocks you can connect to Detections Classes Replacement in version v1.

• inputs: Google Gemini, Keypoint Detection Model, Detections Stabilizer, Image Contours, Path Deviation, Perspective Correction, Gaze Detection, Instance Segmentation Model, Florence-2 Model, PTZ Tracking (ONVIF).md), Local File Sink, Keypoint Detection Model, Clip Comparison, SIFT Comparison, Detections Merge, Time in Zone, Roboflow Custom Metadata, Template Matching, Instance Segmentation Model, Dynamic Zone, Dynamic Crop, Stitch OCR Detections, Time in Zone, Detections Consensus, VLM as Classifier, Single-Label Classification Model, Segment Anything 2 Model, VLM as Classifier, Pixel Color Count, SIFT Comparison, Bounding Rectangle, Detection Offset, Object Detection Model, Twilio SMS Notification, Detections Filter, Llama 3.2 Vision, Multi-Label Classification Model, Email Notification, LMM, Roboflow Dataset Upload, Time in Zone, CSV Formatter, Path Deviation, Detections Transformation, Byte Tracker, Byte Tracker, Single-Label Classification Model, OCR Model, Webhook Sink, Byte Tracker, Object Detection Model, Velocity, Slack Notification, Roboflow Dataset Upload, Detections Classes Replacement, YOLO-World Model, OpenAI, Model Monitoring Inference Aggregator, VLM as Detector, OpenAI, LMM For Classification, Line Counter, Moondream2, Distance Measurement, Multi-Label Classification Model, Overlap Filter, Google Vision OCR, Line Counter, CogVLM, Detections Stitch, Florence-2 Model, VLM as Detector, OpenAI, Anthropic Claude
• outputs: Keypoint Visualization, Detections Stabilizer, Roboflow Dataset Upload, Circle Visualization, Path Deviation, Time in Zone, Path Deviation, Perspective Correction, Color Visualization, Detections Transformation, Mask Visualization, Byte Tracker, Byte Tracker, Florence-2 Model, Blur Visualization, PTZ Tracking (ONVIF).md), Pixelate Visualization, Byte Tracker, Velocity, Dot Visualization, Stability AI Inpainting, Roboflow Dataset Upload, Detections Classes Replacement, Detections Merge, Icon Visualization, Time in Zone, Roboflow Custom Metadata, Model Monitoring Inference Aggregator, Polygon Visualization, Dynamic Zone, Dynamic Crop, Crop Visualization, Stitch OCR Detections, Time in Zone, Ellipse Visualization, Detections Consensus, Line Counter, Trace Visualization, Bounding Box Visualization, Distance Measurement, Segment Anything 2 Model, Overlap Filter, Label Visualization, Line Counter, Corner Visualization, Detections Stitch, Bounding Rectangle, Size Measurement, Detection Offset, Model Comparison Visualization, Background Color Visualization, Detections Filter, Florence-2 Model, Halo Visualization, Triangle Visualization

Input and Output Bindings

The available connections depend on its binding kinds. Check what binding kinds Detections Classes Replacement in version v1 has.

Bindings

• input

  • object_detection_predictions (Union[instance_segmentation_prediction, object_detection_prediction, keypoint_detection_prediction]): The output of a detection model describing the bounding boxes that will have classes replaced..
  • classification_predictions (classification_prediction): The output of classification model for crops taken based on RoIs pointed as the other parameter.
  • fallback_class_name (string): The class name to be used as a fallback if no class is predicted for a bounding box.
  • fallback_class_id (integer): The class id to be used as a fallback if no class is predicted for a bounding box;if not specified or negative, the class id will be set to 9223372036854775807.

• output

  • predictions (Union[object_detection_prediction, instance_segmentation_prediction, keypoint_detection_prediction]): Prediction with detected bounding boxes in form of sv.Detections(...) object if object_detection_prediction or Prediction with detected bounding boxes and segmentation masks in form of sv.Detections(...) object if instance_segmentation_prediction or Prediction with detected bounding boxes and detected keypoints in form of sv.Detections(...) object if keypoint_detection_prediction.

Example JSON definition of step Detections Classes Replacement in version v1

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/detections_classes_replacement@v1",
    "object_detection_predictions": "$steps.my_object_detection_model.predictions",
    "classification_predictions": "$steps.my_classification_model.predictions",
    "fallback_class_name": "unknown",
    "fallback_class_id": 77
}