Model Comparison Visualization¶

Compare predictions from two different models by color-coding areas where only one model detected objects, highlighting model differences while leaving overlapping predictions unchanged to visualize model agreement and disagreement.

How This Block Works¶

This block takes an image and predictions from two models (Model A and Model B) and creates a visual comparison overlay that highlights differences between the models. The block:

1. Takes an image and two sets of predictions (predictions_a and predictions_b) as input
2. Creates masks for areas predicted by each model (using bounding boxes or segmentation masks if available)
3. Identifies four distinct regions:
4. Areas predicted only by Model A (colored with color_a, default green)
5. Areas predicted only by Model B (colored with color_b, default red)
6. Areas predicted by both models (left unchanged, allowing the original image to show through)
7. Areas predicted by neither model (colored with background_color, default black)
8. Applies colored overlays to the identified regions using the specified opacity
9. Returns an annotated image where model differences are visually distinguished with color coding

The block creates a side-by-side comparison visualization that makes it easy to see where models agree (unchanged areas) and where they disagree (color-coded areas). Areas where both models made predictions are left unchanged, allowing the original image to "shine through" and clearly showing model consensus. This visualization helps identify model strengths, weaknesses, and differences in detection behavior. The block works with object detection predictions (using bounding boxes) or instance segmentation predictions (using masks), making it versatile for comparing different model types.

Common Use Cases¶

• Model Evaluation and Comparison: Compare two models' detection performance side-by-side to identify where models agree, disagree, or have different detection behaviors for model evaluation, benchmarking, or selection workflows
• Model Development and Debugging: Visualize differences between model versions, architectures, or configurations to understand how changes affect detection behavior, identify improvement opportunities, or debug model performance issues
• Ensemble Model Analysis: Compare predictions from different models in ensemble workflows to understand model agreement patterns, identify complementary strengths, or analyze consensus areas for ensemble decision-making
• Training Data Analysis: Compare model predictions to ground truth annotations or between training runs to identify patterns in detection differences, validate training improvements, or analyze model behavior across datasets
• A/B Testing and Model Selection: Visually compare candidate models to evaluate relative performance, identify detection differences, or make informed model selection decisions for deployment
• Quality Assurance and Validation: Validate model consistency, compare model performance on edge cases, or identify systematic differences between models for quality assurance, validation, or compliance workflows

Connecting to Other Blocks¶

The annotated image from this block can be connected to:

• Model blocks (e.g., Object Detection Model, Instance Segmentation Model) to receive predictions_a and predictions_b from different models for comparison
• Data storage blocks (e.g., Local File Sink, CSV Formatter, Roboflow Dataset Upload) to save comparison visualizations for documentation, reporting, or analysis
• Webhook blocks to send comparison visualizations to external systems, APIs, or web applications for display in dashboards, model monitoring tools, or evaluation interfaces
• Notification blocks (e.g., Email Notification, Slack Notification) to send comparison visualizations as visual evidence in alerts or reports for model performance monitoring
• Video output blocks to create annotated video streams or recordings with model comparison visualizations for live model evaluation, performance monitoring, or post-processing analysis

Type identifier¶

Use the following identifier in step "type" field: roboflow_core/model_comparison_visualization@v1to add the block as as step in your workflow.

Properties¶

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections¶

Input and Output Bindings¶

The available connections depend on its binding kinds. Check what binding kinds Model Comparison Visualization in version v1 has.

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/model_comparison_visualization@v1",
    "image": "$inputs.image",
    "copy_image": true,
    "predictions_a": "$steps.object_detection_model.predictions",
    "color_a": "GREEN",
    "predictions_b": "$steps.object_detection_model.predictions",
    "color_b": "RED",
    "background_color": "BLACK",
    "opacity": 0.7
}