tensorRT for Yolov3-tiny (onnx to tensorrt)
Ubuntu 18.04/ win10
TensorRT 5.1.5.0/5.1.2.2/5.0.4.3
CUDA 10.0/9.0
Convert your model to onnx model, if your model is trained by DarkNet, check my repo https://github.com/faedtodd/Tensorrt-Yolov3-tiny
#build source code
git submodule update --init --recursive
mkdir build
cd build && cmake .. && make && make install
cd ..
#for fp16
#for yolov3-tiny-608
./install/runYolov3 --onnxmodel=./ped.onnx --enginefile=./ped.trt --input=./test.jpg| Model | GPU | Mode | Inference Time |
|---|---|---|---|
| Yolov3-tiny-608 | GTX 1060 | fp16 | 6.9335ms |
| Yolov3-tiny-608 | Tx2 | fp16 | 20.3274ms |
| Yolov3-416 | GTX 1060 | fp16 | 26.817ms |
| Yolov3-416 | Tx2 | fp16 | 74.1937ms |