SIFT Comparison¶

v2¶

Compare two images or their SIFT descriptors using configurable matcher algorithms (FLANN or brute force), automatically computing SIFT features when images are provided, applying Lowe's ratio test filtering, and optionally generating visualizations of keypoints and matches for image matching, similarity detection, duplicate detection, and feature-based image comparison workflows.

How This Block Works¶

This block compares two images or their SIFT descriptors to determine if they match by finding corresponding features and counting good matches. The block:

1. Receives two inputs (input_1 and input_2) that can be either images or pre-computed SIFT descriptors
2. Processes each input based on its type:
3. If input is an image: Automatically computes SIFT keypoints and descriptors using OpenCV's SIFT detector
   • Converts image to grayscale
   • Detects keypoints and computes 128-dimensional SIFT descriptors
   • Optionally creates keypoint visualization if visualize=True
   • Converts keypoints to dictionary format for output
4. If input is descriptors: Uses the provided descriptors directly (skips SIFT computation)
5. Validates that both descriptor arrays have at least 2 descriptors (required for ratio test filtering)
6. Selects matcher algorithm based on matcher parameter:
7. FlannBasedMatcher (default): Uses FLANN for efficient approximate nearest neighbor search, faster for large descriptor sets
8. BFMatcher: Uses brute force matching with L2 norm, exact matching but slower for large descriptor sets
9. Performs k-nearest neighbor matching (k=2) to find the 2 closest descriptor matches for each descriptor in input_1:
10. For each descriptor in descriptors_1, finds the 2 most similar descriptors in descriptors_2
11. Uses Euclidean distance (L2 norm) in descriptor space to measure similarity
12. Returns matches with distance values indicating how similar the descriptors are
13. Filters good matches using Lowe's ratio test:
14. For each match, compares the distance to the best match (m.distance) with the distance to the second-best match (n.distance)
15. Keeps matches where m.distance < ratio_threshold * n.distance
16. This ratio test filters out ambiguous matches where multiple descriptors are similarly close
17. Lower ratio_threshold values (e.g., 0.6) require more distinct matches (stricter filtering)
18. Higher ratio_threshold values (e.g., 0.8) allow more matches (more lenient filtering)
19. Counts the number of good matches after ratio test filtering
20. Determines if images match by comparing good_matches_count to good_matches_threshold:
21. If good_matches_count >= good_matches_threshold, images_match = True
22. If good_matches_count < good_matches_threshold, images_match = False
23. Optionally generates visualizations if visualize=True and images were provided:
24. Creates keypoint visualizations for each image (images with keypoints drawn)
25. Creates a matches visualization showing corresponding keypoints between the two images connected by lines
26. Returns match results, keypoints, descriptors, and optional visualizations

The block provides flexibility by accepting either images (with automatic SIFT computation) or pre-computed descriptors. When images are provided, the block handles all SIFT processing internally, making it easier to use without requiring separate SIFT feature detection steps. The optional visualization feature helps debug and understand matching results by showing keypoints and matches visually. SIFT descriptors are scale and rotation invariant, making the block effective for matching images with different scales, rotations, or viewing angles.

Common Use Cases¶

• Image Similarity Detection: Determine if two images are similar or match each other (e.g., detect similar images in collections, find matching images in databases, identify duplicate images), enabling image similarity workflows
• Duplicate Image Detection: Identify duplicate or near-duplicate images in image collections (e.g., find duplicate images in photo libraries, detect repeated images in datasets, identify identical images with different scales or orientations), enabling duplicate detection workflows
• Feature-Based Image Matching: Match images based on visual features and keypoints (e.g., match images with similar content, find corresponding images across different views, identify matching images in image sequences), enabling feature-based matching workflows
• Image Verification: Verify if images match expected patterns or references (e.g., verify image authenticity, check if images match reference images, validate image content against templates), enabling image verification workflows
• Image Comparison and Analysis: Compare images to analyze similarities and differences (e.g., compare images for quality control, analyze image variations, measure image similarity scores), enabling image comparison analysis workflows
• Content-Based Image Retrieval: Use feature matching for content-based image search and retrieval (e.g., find similar images in databases, retrieve images by visual similarity, search images by content matching), enabling content-based retrieval workflows

Connecting to Other Blocks¶

This block receives images or SIFT descriptors and produces match results with optional visualizations:

• After image input blocks to compare images directly (e.g., compare input images, match images from camera feeds, analyze image similarities), enabling direct image comparison workflows
• After SIFT feature detection blocks to compare pre-computed SIFT descriptors (e.g., compare descriptors from different images, match images using existing SIFT features, analyze image similarity with pre-computed descriptors), enabling descriptor-based comparison workflows
• Before filtering or logic blocks that use match results for decision-making (e.g., filter based on image matches, make decisions based on similarity, apply logic based on match results), enabling match-based conditional workflows
• Before data storage blocks to store match results and visualizations (e.g., store image match results, save similarity scores, record comparison data with visualizations), enabling match result storage workflows
• Before visualization blocks to further process or display visualizations (e.g., display match visualizations, show keypoint images, render comparison results), enabling visualization workflow outputs
• In image comparison pipelines where multiple images need to be compared (e.g., compare images in sequences, analyze image similarities in workflows, process image comparisons in pipelines), enabling image comparison pipeline workflows

Version Differences¶

This version (v2) includes several enhancements over v1:

• Flexible Input Types: Accepts both images and pre-computed SIFT descriptors as input (v1 only accepted descriptors), allowing direct image comparison without requiring separate SIFT feature detection steps
• Automatic SIFT Computation: Automatically computes SIFT keypoints and descriptors when images are provided, eliminating the need for separate SIFT feature detection blocks in simple workflows
• Matcher Selection: Added configurable matcher parameter to choose between FlannBasedMatcher (default, faster) and BFMatcher (exact, slower), providing flexibility for different performance requirements
• Visualization Support: Added optional visualization feature that generates keypoint visualizations and match visualizations when images are provided, helping debug and understand matching results
• Enhanced Outputs: Returns keypoints and descriptors for both images, plus optional visualizations (keypoint images and match visualization), providing more comprehensive output data for downstream processing

Type identifier¶

Use the following identifier in step "type" field: roboflow_core/sift_comparison@v2to add the block as as step in your workflow.

Properties¶

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections¶

Input and Output Bindings¶

The available connections depend on its binding kinds. Check what binding kinds SIFT Comparison in version v2 has.

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/sift_comparison@v2",
    "input_1": "$inputs.image1",
    "input_2": "$inputs.image2",
    "good_matches_threshold": 50,
    "ratio_threshold": 0.7,
    "matcher": "FlannBasedMatcher",
    "visualize": true
}

v1¶

Compare SIFT (Scale Invariant Feature Transform) descriptors from two images using FLANN-based matching and Lowe's ratio test, determining image similarity by counting feature matches and returning a boolean match result based on a configurable threshold for image matching, similarity detection, duplicate detection, and feature-based image comparison workflows.

How This Block Works¶

This block compares SIFT descriptors from two images to determine if they match by finding corresponding features and counting good matches. The block:

1. Receives SIFT descriptors from two images (descriptor_1 and descriptor_2) - these descriptors should come from a SIFT feature detection step that has already extracted keypoints and computed descriptors for both images
2. Validates that both descriptor arrays have at least 2 descriptors (required for ratio test filtering - needs at least 2 nearest neighbors)
3. Creates a FLANN (Fast Library for Approximate Nearest Neighbors) based matcher:
4. Uses FLANN algorithm for efficient approximate nearest neighbor search in high-dimensional descriptor space
5. Configures FLANN with algorithm parameters optimized for SIFT descriptors (algorithm=1, trees=5, checks=50)
6. FLANN is faster than brute force matching for large descriptor sets while maintaining good accuracy
7. Performs k-nearest neighbor matching (k=2) to find the 2 closest descriptor matches for each descriptor in image 1:
8. For each descriptor in descriptor_1, finds the 2 most similar descriptors in descriptor_2
9. Uses Euclidean distance in descriptor space to measure similarity
10. Returns matches with distance values indicating how similar the descriptors are
11. Filters good matches using Lowe's ratio test:
12. For each match, compares the distance to the best match (m.distance) with the distance to the second-best match (n.distance)
13. Keeps matches where m.distance < ratio_threshold * n.distance
14. This ratio test filters out ambiguous matches where multiple descriptors are similarly close
15. Lower ratio_threshold values (e.g., 0.6) require more distinct matches (stricter filtering)
16. Higher ratio_threshold values (e.g., 0.8) allow more matches (more lenient filtering)
17. Counts the number of good matches after ratio test filtering
18. Determines if images match by comparing good_matches_count to good_matches_threshold:
19. If good_matches_count >= good_matches_threshold, images_match = True
20. If good_matches_count < good_matches_threshold, images_match = False
21. Returns the count of good matches and the boolean match result

The block uses SIFT descriptors which are scale and rotation invariant, making it effective for matching images with different scales, rotations, or viewing angles. FLANN matching provides efficient approximate nearest neighbor search for fast comparison of large descriptor sets. Lowe's ratio test improves match quality by filtering ambiguous matches where the best match isn't significantly better than alternatives. The threshold-based matching allows configurable sensitivity - lower thresholds require fewer matches (more lenient), higher thresholds require more matches (stricter).

Common Use Cases¶

• Image Similarity Detection: Determine if two images are similar or match each other (e.g., detect similar images in collections, find matching images in databases, identify duplicate images), enabling image similarity workflows
• Duplicate Image Detection: Identify duplicate or near-duplicate images in image collections (e.g., find duplicate images in photo libraries, detect repeated images in datasets, identify identical images with different scales or orientations), enabling duplicate detection workflows
• Feature-Based Image Matching: Match images based on visual features and keypoints (e.g., match images with similar content, find corresponding images across different views, identify matching images in image sequences), enabling feature-based matching workflows
• Image Verification: Verify if images match expected patterns or references (e.g., verify image authenticity, check if images match reference images, validate image content against templates), enabling image verification workflows
• Image Comparison and Analysis: Compare images to analyze similarities and differences (e.g., compare images for quality control, analyze image variations, measure image similarity scores), enabling image comparison analysis workflows
• Content-Based Image Retrieval: Use feature matching for content-based image search and retrieval (e.g., find similar images in databases, retrieve images by visual similarity, search images by content matching), enabling content-based retrieval workflows

Connecting to Other Blocks¶

This block receives SIFT descriptors from two images and produces match results:

• After SIFT feature detection blocks to compare SIFT descriptors from different images (e.g., compare descriptors from multiple images, match images using SIFT features, analyze image similarity with SIFT), enabling SIFT-based image comparison workflows
• Before filtering or logic blocks that use match results for decision-making (e.g., filter based on image matches, make decisions based on similarity, apply logic based on match results), enabling match-based conditional workflows
• Before data storage blocks to store match results (e.g., store image match results, save similarity scores, record comparison data), enabling match result storage workflows
• In image comparison pipelines where multiple images need to be compared (e.g., compare images in sequences, analyze image similarities in workflows, process image comparisons in pipelines), enabling image comparison pipeline workflows
• Before visualization blocks to visualize match results (e.g., display match results, visualize similar images, show comparison outcomes), enabling match visualization workflows
• In duplicate detection workflows where images need to be checked for duplicates (e.g., detect duplicates in image collections, find repeated images, identify identical images), enabling duplicate detection workflows

Type identifier¶

Use the following identifier in step "type" field: roboflow_core/sift_comparison@v1to add the block as as step in your workflow.

Properties¶

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections¶

Input and Output Bindings¶

The available connections depend on its binding kinds. Check what binding kinds SIFT Comparison in version v1 has.

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/sift_comparison@v1",
    "descriptor_1": "$steps.sift.descriptors",
    "descriptor_2": "$steps.sift.descriptors",
    "good_matches_threshold": 50,
    "ratio_threshold": 0.7
}