Detections Classes Replacement

Class: DetectionsClassesReplacementBlockV1

Source: inference.core.workflows.core_steps.fusion.detections_classes_replacement.v1.DetectionsClassesReplacementBlockV1

Combine results of detection model with classification results performed separately for each and every bounding box.

Bounding boxes without top class predicted by classification model are discarded, for multi-label classification results, most confident label is taken as bounding box class.

Type identifier

Use the following identifier in step "type" field: roboflow_core/detections_classes_replacement@v1to add the block as as step in your workflow.

Properties

Name	Type	Description	Refs
name	str	Enter a unique identifier for this step..	❌
fallback_class_name	str	The class name to be used as a fallback if no class is predicted for a bounding box.	✅
fallback_class_id	int	The class id to be used as a fallback if no class is predicted for a bounding box;if not specified or negative, the class id will be set to 9223372036854775807.	✅

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections

Compatible Blocks

Check what blocks you can connect to Detections Classes Replacement in version v1.

• inputs: Anthropic Claude, Segment Anything 2 Model, Stitch OCR Detections, Line Counter, Keypoint Detection Model, Line Counter, LMM For Classification, PTZ Tracking (ONVIF).md), Slack Notification, Detections Stabilizer, Image Contours, Byte Tracker, Path Deviation, Multi-Label Classification Model, SIFT Comparison, Overlap Filter, Llama 3.2 Vision, Google Gemini, Gaze Detection, Pixel Color Count, VLM as Detector, VLM as Classifier, Object Detection Model, Time in Zone, Instance Segmentation Model, Dynamic Zone, Multi-Label Classification Model, Keypoint Detection Model, CSV Formatter, Google Vision OCR, VLM as Classifier, Byte Tracker, Detections Consensus, Roboflow Dataset Upload, CogVLM, Byte Tracker, Roboflow Dataset Upload, Detection Offset, Single-Label Classification Model, Detections Filter, OpenAI, Roboflow Custom Metadata, Time in Zone, Email Notification, OCR Model, Object Detection Model, Bounding Rectangle, Local File Sink, OpenAI, Detections Transformation, Single-Label Classification Model, LMM, Detections Classes Replacement, YOLO-World Model, Detections Merge, OpenAI, Perspective Correction, Moondream2, Florence-2 Model, Florence-2 Model, Path Deviation, Model Monitoring Inference Aggregator, Template Matching, Instance Segmentation Model, Twilio SMS Notification, Velocity, Detections Stitch, Webhook Sink, SIFT Comparison, Clip Comparison, Distance Measurement, VLM as Detector, Dynamic Crop
• outputs: Crop Visualization, Stitch OCR Detections, Line Counter, Segment Anything 2 Model, Line Counter, Triangle Visualization, Blur Visualization, PTZ Tracking (ONVIF).md), Background Color Visualization, Color Visualization, Detections Stabilizer, Corner Visualization, Byte Tracker, Path Deviation, Mask Visualization, Icon Visualization, Overlap Filter, Circle Visualization, Pixelate Visualization, Model Comparison Visualization, Time in Zone, Dynamic Zone, Byte Tracker, Detections Consensus, Roboflow Dataset Upload, Byte Tracker, Roboflow Dataset Upload, Detection Offset, Detections Filter, Trace Visualization, Roboflow Custom Metadata, Polygon Visualization, Keypoint Visualization, Dot Visualization, Time in Zone, Bounding Rectangle, Detections Transformation, Bounding Box Visualization, Detections Classes Replacement, Ellipse Visualization, Size Measurement, Halo Visualization, Detections Merge, Perspective Correction, Florence-2 Model, Stability AI Inpainting, Florence-2 Model, Path Deviation, Model Monitoring Inference Aggregator, Velocity, Detections Stitch, Label Visualization, Distance Measurement, Dynamic Crop

Input and Output Bindings

The available connections depend on its binding kinds. Check what binding kinds Detections Classes Replacement in version v1 has.

Bindings

• input

  • object_detection_predictions (Union[object_detection_prediction, instance_segmentation_prediction, keypoint_detection_prediction]): The output of a detection model describing the bounding boxes that will have classes replaced..
  • classification_predictions (classification_prediction): The output of classification model for crops taken based on RoIs pointed as the other parameter.
  • fallback_class_name (string): The class name to be used as a fallback if no class is predicted for a bounding box.
  • fallback_class_id (integer): The class id to be used as a fallback if no class is predicted for a bounding box;if not specified or negative, the class id will be set to 9223372036854775807.

• output

  • predictions (Union[object_detection_prediction, instance_segmentation_prediction, keypoint_detection_prediction]): Prediction with detected bounding boxes in form of sv.Detections(...) object if object_detection_prediction or Prediction with detected bounding boxes and segmentation masks in form of sv.Detections(...) object if instance_segmentation_prediction or Prediction with detected bounding boxes and detected keypoints in form of sv.Detections(...) object if keypoint_detection_prediction.

Example JSON definition of step Detections Classes Replacement in version v1

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/detections_classes_replacement@v1",
    "object_detection_predictions": "$steps.my_object_detection_model.predictions",
    "classification_predictions": "$steps.my_classification_model.predictions",
    "fallback_class_name": "unknown",
    "fallback_class_id": 77
}