Commit Graph

3657 Commits

Author SHA1 Message Date
Nicolas Mowen
0ec536a4e5 Face recognition improvements (#16034) 2025-01-18 21:34:09 -07:00
Nicolas Mowen
9a2de78fc9 Bird classification (#15966)
* Start working on bird processor

* Initial setup for bird processing

* Improvements to handling

* Get classification working

* Cleanup classification

* Add classification config

* Update sort
2025-01-18 21:34:09 -07:00
Nicolas Mowen
c9c011f05b Update hailo deps (#15958) 2025-01-18 21:34:09 -07:00
Nicolas Mowen
e23c046136 Processing refactor (#15935)
* Refactor post processor to be real time processor

* Build out generic API for post processing

* Cleanup

* Fix
2025-01-18 21:34:09 -07:00
Nicolas Mowen
eed292c73e Generalize postprocessing (#15931)
* Actually send result to face registration

* Define postprocessing api and move face processing to fit

* Standardize request handling

* Standardize handling of processors

* Rename processing metrics

* Cleanup

* Standardize object end

* Update to newer formatting

* One more

* One more
2025-01-18 21:34:09 -07:00
Nicolas Mowen
8430d5626a Fix onvif packages (#15906)
* Don't replace packages

* Formatting
2025-01-18 21:34:09 -07:00
Josh Hawkins
3ba35a07e0 Only print line and key/value when a line number can be found (#15897) 2025-01-18 21:34:09 -07:00
Nicolas Mowen
fa652ca49d Upgrade onvif-zeep dependency to use onvif-zeep-async (#15894)
* Upgrade to new dependency

* Start onvif work

* Update for async calls
2025-01-18 21:34:09 -07:00
Nicolas Mowen
0fc1a48230 Improvements to face recognition (#15854)
* Do not add margin to face images

* remove margin

* Correctly clear
2025-01-18 21:34:09 -07:00
Nicolas Mowen
17274ab0d5 Add metrics page for embeddings and face / license plate processing times (#15818)
* Get stats for embeddings inferences

* cleanup embeddings inferences

* Enable UI for feature metrics

* Change threshold

* Fix check

* Update python for actions

* Set python version

* Ignore type for now
2025-01-18 21:34:09 -07:00
Nicolas Mowen
bb51a21bed Fix facedet download (#15811)
* Support downloading face models

* Handle download and loading correctly

* Add face dir creation

* Fix error

* Fix

* Formatting

* Move upload to button

* Show number of faces in library for each name

* Add text color for score

* Cleanup
2025-01-18 21:34:09 -07:00
Nicolas Mowen
f4501a2094 Refactor camera activity processing (#15803)
* Replace object label sensors with new manager

* Implement zone topics

* remove unused
2025-01-18 21:34:09 -07:00
Marc Altmann
7c2ff818a5 rockchip: update dependencies and add script for model conversion (#15699)
* rockchip: update dependencies and add script for model conversion

* rockchip: update docs

---------

Co-authored-by: Nicolas Mowen <nickmowen213@gmail.com>
2025-01-18 21:34:09 -07:00
Nicolas Mowen
eb85079f74 Add support for SR-IOV GPU stats (#15796)
* Add option to treat GPU as SRIOV in order for stats to work correctly

* Add to intel docs

* fix tests
2025-01-18 21:34:09 -07:00
Nicolas Mowen
f2cc16bf3c Add ffmpeg config to increase HEVC compatibility with Apple devices (#15795)
* Add config option for handling HEVC playback on Apple devices

* Update docs

* Remove unused
2025-01-18 21:34:09 -07:00
Nicolas Mowen
dff6a20764 Implement face recognition training in UI (#15786)
* Rename debug to train

* Add api to train image as person

* Cleanup model running

* Formatting

* Fix

* Set face recognition page title
2025-01-18 21:34:09 -07:00
Nicolas Mowen
f513e3fb3d Add UI for managing face recognitions (#15757)
* Add ability to view attempts

* Improve UI

* Cleanup

* Correctly refresh ui when item is deleted

* Select correct library by default

* Add min score

* Cleanup
2025-01-18 21:34:09 -07:00
Nicolas Mowen
5c6f169975 Face recognition logic improvements (#15679)
* Always initialize face model on startup

* Add ability to save face images for debugging

* Implement better face recognition reasonability
2025-01-18 21:34:09 -07:00
Nicolas Mowen
5a2113a62d Change folder 2025-01-18 21:34:09 -07:00
Nicolas Mowen
8682b31ce5 Set model size 2025-01-18 21:34:09 -07:00
Nicolas Mowen
9d547e1862 Improve face recognition (#15670)
* Face recognition tuning

* Support face alignment

* Cleanup

* Correctly download model
2025-01-18 21:34:09 -07:00
Nicolas Mowen
dd0d2780ec Update TRT (#15646) 2025-01-18 21:34:09 -07:00
Nicolas Mowen
1d5a2e58b8 Make face library scrollable 2025-01-18 21:34:09 -07:00
Nicolas Mowen
4d2cfcb29f Update openvino (#15634) 2025-01-18 21:34:09 -07:00
Nicolas Mowen
f1dd7a5a5e Update python deps (#15618)
* Update opencv

* Update cython

* Update scikit

* Update scipy
2025-01-18 21:34:09 -07:00
Nicolas Mowen
baa068acdf Enable temporary caching of camera images to improve responsiveness of UI (#15614) 2025-01-18 21:34:09 -07:00
Josh Hawkins
69a2f948f2 Preserve line numbers in config validation (#15584)
* use ruamel to parse and preserve line numbers for config validation

* maintain exception for non validation errors

* fix types

* include input in log messages
2025-01-18 21:34:09 -07:00
Nicolas Mowen
0aabf9a24f Update base image (#15103)
* Change base image

* Update python

* Update coral library

* Fix source file

* Install correct apt packages

* Cleanup

* Fix installation of coral deps

* fix python installations

* Fix devcontainer build

* Get tensorrt build working

* Update other deps

* Filter out tflite log

* Get ROCm build working

* Get rockchip build working

* Get hailo build working

* Add note to comment
2025-01-18 21:34:09 -07:00
Nicolas Mowen
99992fd18f Face recognition fixes (#15222)
* Fix nginx max upload size

* Close upload dialog when done and add toasts

* Formatting

* fix ruff
2025-01-18 21:34:09 -07:00
Nicolas Mowen
03c8e5ce8d Improve face recognition (#15205)
* Validate faces using cosine distance and SVC

* Formatting

* Use opencv instead of face embedding

* Update docs for training data

* Adjust to score system

* Set bounds

* remove face embeddings

* Update writing images

* Add face library page

* Add ability to select file

* Install opencv deps

* Cleanup

* Use different deps

* Move deps

* Cleanup

* Only show face library for desktop

* Implement deleting

* Add ability to upload image

* Add support for uploading images
2025-01-18 21:34:09 -07:00
Nicolas Mowen
ffcbc1b73e Remove standardization 2025-01-18 21:34:09 -07:00
Nicolas Mowen
cec52ff907 Fix check 2025-01-18 21:34:09 -07:00
Nicolas Mowen
4502543252 Remove hardcoded face name 2025-01-18 21:34:09 -07:00
Nicolas Mowen
1129f56b32 Use SVC to normalize and classify faces for recognition (#14835)
* Add margin to detected faces for embeddings

* Standardize pixel values for face input

* Use SVC to classify faces

* Clear classifier when new face is added

* Formatting

* Add dependency
2025-01-18 21:34:09 -07:00
Josh Hawkins
474f2efa92 Use regular expressions for plate matching (#14727) 2025-01-18 21:34:09 -07:00
Nicolas Mowen
6eb26cecc9 Update facenet model (#14647) 2025-01-18 21:34:09 -07:00
Josh Hawkins
1eb315127b LPR improvements (#14641) 2025-01-18 21:34:09 -07:00
Josh Hawkins
53712fb70d Prevent division by zero in lpr confidence checks (#14615) 2025-01-18 21:34:09 -07:00
Nicolas Mowen
53293c997f Fix label check (#14610)
* Create config for parsing object

* Use in maintainer
2025-01-18 21:34:09 -07:00
Josh Hawkins
ecee75c348 License plate recognition (ALPR) backend (#14564)
* Update version

* Face recognition backend (#14495)

* Add basic config and face recognition table

* Reconfigure updates processing to handle face

* Crop frame to face box

* Implement face embedding calculation

* Get matching face embeddings

* Add support face recognition based on existing faces

* Use arcface face embeddings instead of generic embeddings model

* Add apis for managing faces

* Implement face uploading API

* Build out more APIs

* Add min area config

* Handle larger images

* Add more debug logs

* fix calculation

* Reduce timeout

* Small tweaks

* Use webp images

* Use facenet model

* Improve face recognition (#14537)

* Increase requirements for face to be set

* Manage faces properly

* Add basic docs

* Simplify

* Separate out face recognition frome semantic search

* Update docs

* Formatting

* Fix access (#14540)

* Face detection (#14544)

* Add support for face detection

* Add support for detecting faces during registration

* Set body size to be larger

* Undo

* Update version

* Face recognition backend (#14495)

* Add basic config and face recognition table

* Reconfigure updates processing to handle face

* Crop frame to face box

* Implement face embedding calculation

* Get matching face embeddings

* Add support face recognition based on existing faces

* Use arcface face embeddings instead of generic embeddings model

* Add apis for managing faces

* Implement face uploading API

* Build out more APIs

* Add min area config

* Handle larger images

* Add more debug logs

* fix calculation

* Reduce timeout

* Small tweaks

* Use webp images

* Use facenet model

* Improve face recognition (#14537)

* Increase requirements for face to be set

* Manage faces properly

* Add basic docs

* Simplify

* Separate out face recognition frome semantic search

* Update docs

* Formatting

* Fix access (#14540)

* Face detection (#14544)

* Add support for face detection

* Add support for detecting faces during registration

* Set body size to be larger

* Undo

* initial foundation for alpr with paddleocr

* initial foundation for alpr with paddleocr

* initial foundation for alpr with paddleocr

* config

* config

* lpr maintainer

* clean up

* clean up

* fix processing

* don't process for stationary cars

* fix order

* fixes

* check for known plates

* improved length and character by character confidence

* model fixes and small tweaks

* docs

* placeholder for non frigate+ model lp detection

---------

Co-authored-by: Nicolas Mowen <nickmowen213@gmail.com>
2025-01-18 21:34:09 -07:00
Nicolas Mowen
66abb64444 Face detection (#14544)
* Add support for face detection

* Add support for detecting faces during registration

* Set body size to be larger

* Undo
2025-01-18 21:34:09 -07:00
Nicolas Mowen
a75a981ebf Fix access (#14540) 2025-01-18 21:34:09 -07:00
Nicolas Mowen
37085156b7 Improve face recognition (#14537)
* Increase requirements for face to be set

* Manage faces properly

* Add basic docs

* Simplify

* Separate out face recognition frome semantic search

* Update docs

* Formatting
2025-01-18 21:34:09 -07:00
Nicolas Mowen
4203865f9d Face recognition backend (#14495)
* Add basic config and face recognition table

* Reconfigure updates processing to handle face

* Crop frame to face box

* Implement face embedding calculation

* Get matching face embeddings

* Add support face recognition based on existing faces

* Use arcface face embeddings instead of generic embeddings model

* Add apis for managing faces

* Implement face uploading API

* Build out more APIs

* Add min area config

* Handle larger images

* Add more debug logs

* fix calculation

* Reduce timeout

* Small tweaks

* Use webp images

* Use facenet model
2025-01-18 21:34:09 -07:00
Nicolas Mowen
f84f9b705d Update version 2025-01-18 21:34:09 -07:00
Nicolas Mowen
83ac42cbdc
Use correct path for script (#16045) 2025-01-18 21:33:13 -07:00
Nicolas Mowen
a5ce8d0d77
Fix env variable exporting (#16043) 2025-01-18 21:31:56 -06:00
Nicolas Mowen
0ee2e404da
Correctly calculate ffmpeg version based on ffmpeg path (#16041)
* Correctly calculate ffmpeg version based on ffmpeg path

* Formatting
2025-01-18 20:30:35 -06:00
Marc Altmann
3947e79086
update FFmpeg to ensure compatibility with newer kernels (#16027) 2025-01-18 05:48:28 -07:00
Nicolas Mowen
91ab1071d2
Update docs to make note of go2rtc port requirement (#16013) 2025-01-16 16:14:40 -07:00