Minimum Requirements¶
Inference adapts to your machine's resources and will run faster on more powerful machines but it cannot run on all devices.
In order to run Inference, we recommend the following minimum requirements:
- 64-bit Processor
- 4GB of RAM
- 20GB of free disk space
Additional Requirements for Windows
To run on Windows, you need Windows 10 or Windows 11 with Windows Subsystem for Linux (WSL 2) activated.
GPU Recommended¶
Inference is capable of using hardware acceleration on NVIDIA GPUs. While not required, to run bigger models and live streaming video we recommend a CUDA-capable GPU.
Suggested Edge Devices¶
NVIDIA Jetson Orin devices with JetPack 5 or JetPack 6 are powerful, well-rounded machines. Our test-suite regularly runs against these devices.
The Jetson Orin Nano Super Developer Kit is a good device to start building with.