Perception Encoder Embedding Model

Class: PerceptionEncoderModelBlockV1

Source: inference.core.workflows.core_steps.models.foundation.perception_encoder.v1.PerceptionEncoderModelBlockV1

Use the Meta Perception Encoder model to create semantic embeddings of text and images.

This block accepts an image or string and returns an embedding. The embedding can be used to compare similarity between different images or between images and text.

Type identifier

Use the following identifier in step "type" field: roboflow_core/perception_encoder@v1to add the block as as step in your workflow.

Properties

Name	Type	Description	Refs
name	str	Unique name of step in workflows.	❌
data	str	The string or image to generate an embedding for..	✅
version	str	Variant of Perception Encoder model.	✅

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Available Connections

Compatible Blocks

Check what blocks you can connect to Perception Encoder Embedding Model in version v1.

• inputs: Local File Sink, Dot Visualization, Stability AI Inpainting, Reference Path Visualization, VLM as Classifier, Stability AI Outpainting, Multi-Label Classification Model, QR Code Generator, Line Counter Visualization, Ellipse Visualization, Roboflow Custom Metadata, Background Color Visualization, Polygon Zone Visualization, CSV Formatter, Roboflow Dataset Upload, Contrast Equalization, EasyOCR, Object Detection Model, Image Slicer, Google Gemini, Florence-2 Model, Google Vision OCR, Image Threshold, SIFT Comparison, Image Preprocessing, Icon Visualization, OCR Model, Roboflow Dataset Upload, Absolute Static Crop, Pixelate Visualization, Image Blur, Perspective Correction, Relative Static Crop, Florence-2 Model, VLM as Detector, LMM For Classification, Llama 3.2 Vision, Clip Comparison, LMM, SIFT, Halo Visualization, Model Monitoring Inference Aggregator, Image Convert Grayscale, Anthropic Claude, Triangle Visualization, Depth Estimation, Image Contours, Mask Visualization, Keypoint Detection Model, Image Slicer, CogVLM, Model Comparison Visualization, Stitch OCR Detections, Twilio SMS Notification, Single-Label Classification Model, Polygon Visualization, Corner Visualization, Crop Visualization, Stitch Images, Blur Visualization, Dynamic Crop, Camera Focus, OpenAI, Email Notification, Color Visualization, Classification Label Visualization, Label Visualization, OpenAI, Circle Visualization, Keypoint Visualization, Trace Visualization, Camera Calibration, Instance Segmentation Model, Morphological Transformation, OpenAI, Bounding Box Visualization, Grid Visualization, Slack Notification, Webhook Sink, Stability AI Image Generation
• outputs: Identify Outliers, Cosine Similarity, Identify Changes

Input and Output Bindings

The available connections depend on its binding kinds. Check what binding kinds Perception Encoder Embedding Model in version v1 has.

Bindings

• input

  • data (Union[image, string]): The string or image to generate an embedding for..
  • version (string): Variant of Perception Encoder model.

• output

  • embedding (embedding): A list of floating point numbers representing a vector embedding..

Example JSON definition of step Perception Encoder Embedding Model in version v1

{
    "name": "<your_step_name_here>",
    "type": "roboflow_core/perception_encoder@v1",
    "data": "$inputs.image",
    "version": "PE-Core-B16-224"
}