NVR with realtime local object detection for IP cameras
Go to file
Nate Meyer 3f05f74ecb
Nvidia TensorRT detector (#4718)
* Initial WIP dockerfile and scripts to add tensorrt support

* Add tensorRT detector

* WIP attempt to install TensorRT 8.5

* Updates to detector for cuda python library

* TensorRT Cuda library rework WIP

Does not run

* Fixes from rebase to detector factory

* Fix parsing output memory pointer

* Handle TensorRT logs with the python logger

* Use non-async interface and convert input data to float32. Detection runs without error.

* Make TensorRT a separate build from the base Frigate image.

* Add script and documentation for generating TRT Models

* Add support for TensorRT devcontainer

* Add labelmap to trt model script and docs.  Cleanup of old scripts.

* Update detect to normalize input tensor using model input type

* Add config for selecting GPU. Fix Async inference. Update documentation.

* Update some CUDA libraries to clean up version warning

* Add CI stage to build TensorRT tag

* Add note in docs for image tag and model support
2022-12-30 10:53:17 -06:00
.devcontainer Set User Agent for FFmpeg calls (#4555) 2022-11-30 16:53:45 -06:00
.github Nvidia TensorRT detector (#4718) 2022-12-30 10:53:17 -06:00
.vscode Set User Agent for FFmpeg calls (#4555) 2022-11-30 16:53:45 -06:00
config Improve the devcontainer experience (#3492) 2022-11-20 07:34:12 -06:00
docker Nvidia TensorRT detector (#4718) 2022-12-30 10:53:17 -06:00
docs Nvidia TensorRT detector (#4718) 2022-12-30 10:53:17 -06:00
frigate Nvidia TensorRT detector (#4718) 2022-12-30 10:53:17 -06:00
migrations Limit recording retention to available storage (#3942) 2022-10-09 06:28:26 -05:00
web Fix config missing (#4825) 2022-12-30 09:52:10 -06:00
.dockerignore Improve the devcontainer experience (#3492) 2022-11-20 07:34:12 -06:00
.gitignore Merge remote-tracking branch 'origin/master' into dev 2022-12-17 18:07:01 -06:00
.pylintrc use fstr log style 2021-02-25 07:01:59 -06:00
benchmark.py Refactor to simplify support for additional detector types (#3656) 2022-11-03 21:23:09 -05:00
docker-compose.yml Nvidia TensorRT detector (#4718) 2022-12-30 10:53:17 -06:00
Dockerfile Nvidia TensorRT detector (#4718) 2022-12-30 10:53:17 -06:00
labelmap.txt refactor and reduce false positives 2020-09-17 07:37:27 -05:00
LICENSE switch to MIT license 2020-07-26 12:07:47 -05:00
Makefile Nvidia TensorRT detector (#4718) 2022-12-30 10:53:17 -06:00
process_clip.py Refactor to simplify support for additional detector types (#3656) 2022-11-03 21:23:09 -05:00
README.md update docs url 2021-09-26 16:43:26 -05:00
requirements-dev.txt Easy Python Updates (#4424) 2022-11-18 06:33:10 -06:00
requirements-ov.txt Add OpenVino Detector (#3768) 2022-12-03 10:19:34 -06:00
requirements-tensorrt.txt Nvidia TensorRT detector (#4718) 2022-12-30 10:53:17 -06:00
requirements-wheels.txt Use UTC for recordings (#4656) 2022-12-11 07:45:32 -06:00
requirements.txt Nvidia TensorRT detector (#4718) 2022-12-30 10:53:17 -06:00

logo

Frigate - NVR With Realtime Object Detection for IP Cameras

A complete and local NVR designed for Home Assistant with AI object detection. Uses OpenCV and Tensorflow to perform realtime object detection locally for IP cameras.

Use of a Google Coral Accelerator is optional, but highly recommended. The Coral will outperform even the best CPUs and can process 100+ FPS with very little overhead.

  • Tight integration with Home Assistant via a custom component
  • Designed to minimize resource use and maximize performance by only looking for objects when and where it is necessary
  • Leverages multiprocessing heavily with an emphasis on realtime over processing every frame
  • Uses a very low overhead motion detection to determine where to run object detection
  • Object detection with TensorFlow runs in separate processes for maximum FPS
  • Communicates over MQTT for easy integration into other systems
  • Records video with retention settings based on detected objects
  • 24/7 recording
  • Re-streaming via RTMP to reduce the number of connections to your camera

Documentation

View the documentation at https://docs.frigate.video

Donations

If you would like to make a donation to support development, please use Github Sponsors.

Screenshots

Integration into Home Assistant

Also comes with a builtin UI:

Events