Running YOLO with Depth-PRO

[BadriPratti]

Hey everyone,

I’m running YOLO with Depth Pro on a Jetson AGX Orin using a webcam, but it’s super laggy—about 1 frame every 10 seconds.

I’ve tried lowering the resolution, skipping frames, and ensuring GPU usage, but it’s still far from real-time. Should I use TensorRT, model quantization, or anything else specific to Jetson to speed it up?

[I3aer]

TensorRT can be your answer. Also, find tools that trim the model with some minor changes on accuracy. Drop the precision to fp16. Don't expect much from Orin for this model since it is huge.