blakeblackshear.frigate/frigate/detectors/plugins
Nate Meyer 3f05f74ecb
Nvidia TensorRT detector (#4718)
* Initial WIP dockerfile and scripts to add tensorrt support

* Add tensorRT detector

* WIP attempt to install TensorRT 8.5

* Updates to detector for cuda python library

* TensorRT Cuda library rework WIP

Does not run

* Fixes from rebase to detector factory

* Fix parsing output memory pointer

* Handle TensorRT logs with the python logger

* Use non-async interface and convert input data to float32. Detection runs without error.

* Make TensorRT a separate build from the base Frigate image.

* Add script and documentation for generating TRT Models

* Add support for TensorRT devcontainer

* Add labelmap to trt model script and docs.  Cleanup of old scripts.

* Update detect to normalize input tensor using model input type

* Add config for selecting GPU. Fix Async inference. Update documentation.

* Update some CUDA libraries to clean up version warning

* Add CI stage to build TensorRT tag

* Add note in docs for image tag and model support
2022-12-30 10:53:17 -06:00
..
__init__.py Convert detectors to factory pattern, ability to set different model for each detector (#4635) 2022-12-15 07:12:52 -06:00
cpu_tfl.py
edgetpu_tfl.py
openvino.py Convert detectors to factory pattern, ability to set different model for each detector (#4635) 2022-12-15 07:12:52 -06:00
tensorrt.py Nvidia TensorRT detector (#4718) 2022-12-30 10:53:17 -06:00