Josh Hawkins
a88760efa1
Display warning in frontend if shm size is too low ( #19712 )
...
* backend
refactor shm calculation to utility function so it can be used in frontend stats
* frontend
* fix check
* clean up
2025-08-22 13:48:27 -06:00
Tim Wesley
dbceb4dcc7
MemryX MX3 detector integration ( #17723 )
...
* sdk_2.0_update
* memryx docs: minor reorg
* ran ruff
* whoops, more ruff fixes
* Fixes (#6 )
* Fixes and custom model path updated
* ruff formatting
* removed apt install from main
* add comment about libgomp1 in install_deps
---------
Co-authored-by: Abinila Siva <abinila.siva@memryx.com>
Co-authored-by: Abinila Siva <163017635+abinila4@users.noreply.github.com>
2025-08-22 08:11:48 -05:00
Nicolas Mowen
9dd7ead462
Camera Health Status ( #19709 )
...
* Send status of camera streams to mqtt
* Update docs
* Formatting
* Fix frontend querying fps
2025-08-22 06:42:36 -06:00
Nicolas Mowen
539c760953
Don't print when not using rknn ( #19698 )
...
* Debug logs for rknn embeddings check
* Debug logs for rknn embeddings check
2025-08-21 18:00:36 -05:00
Nicolas Mowen
f39475a383
Support face recognition via RKNN ( #19687 )
...
* Add support for face recognition via RKNN
* Fix crash when adding camera in via UI
* Update docs regarding support for face recognition
* Formatting
2025-08-21 06:18:55 -06:00
Nicolas Mowen
1be84d6833
Add automatic RKNN conversion and support for semantic search model ( #19676 )
...
* Create RKNN model runner and and use for jina v1 clip
* Formatting
* Handle model type inference
* Properly provide input to RKNN
* Adjust rknn conversion
* Update docs
* Formatting
* Fix path handling
* Handle inputs
* Cleanup
* Change normalization for better accuracy
* Clarify supported models
* Remove testing
2025-08-21 05:30:14 -06:00
Nicolas Mowen
2236ecf23f
Auto convert ONNX models to RKNN format ( #19674 )
...
* Implement base rknn conversion
* Remove unused
* Formatting
* Add model conversion lock so it doesn't break when multiple detectors are defined
* Ignore unused impor
t
2025-08-20 15:15:57 -06:00
Nicolas Mowen
6e3b40eaee
Fix record motion config ( #19672 )
...
* fix record config
* Formatting
2025-08-20 14:45:17 -06:00
Nicolas Mowen
9fb09408d1
Fix build ( #19634 )
...
* Don't put special constraints
* Undo joserfc install
* Fix joserfc
* Formatting
2025-08-19 13:19:31 -06:00
Nicolas Mowen
e92267d7e2
Update deps ( #19617 )
...
* Update virtualenv
* Fix device ID
* Fix dependency conflict
* Cleanup mypy
2025-08-19 11:08:34 -05:00
Nicolas Mowen
acf32e1a1e
Various Fixes ( #19615 )
...
* Don't write to write None response to file
* fix genai config migration
* Fix JP6 build
* Include base image ARG
2025-08-19 06:49:55 -06:00
baudneo
33f3ea3b59
Enrichments: Allow targeting a specific GPU ID ( #19342 )
2025-08-18 17:43:53 -06:00
scyto
83e9ae616a
Enable Optional IPv6 Support for Nginx ( #19602 )
2025-08-18 17:39:12 -06:00
Nicolas Mowen
152d9ed4a0
Apple Silicon / ZMQ Detector ( #19592 )
...
* Add zmq detector
* Cleanup
* Logging
* Cleanup
* Cleanup
* Add to hardware docs
* Add apple silicon to docs
* Formatting
2025-08-18 09:51:12 -05:00
Nicolas Mowen
5a49d1f73c
Enable mypy for track
and fix typing errors ( #19529 )
...
* Enable mypy for track
* WIP cleaning up tracked object
* Fix tracked object typing
* Fix typing and imports of centroid tracker
* Cleanup typing
* Cleanup
* Formatting
* Fix imports
* Don't specify callable type
* Type out json setting
2025-08-17 12:27:42 -05:00
Nicolas Mowen
856aab8e6e
Cleanup filename sanitization
2025-08-16 10:20:33 -05:00
Nicolas Mowen
ccbaa74a8b
Improve natural language of prompt ( #19515 )
...
* Make sequence details human-readable so they are used in natural language response
* Cleanup
* Improve prompt and image selection
* Adjust
* Adjust sligtly
* Format time
* Adjust frame selection logic
* Debug save response
* Ignore extra fields
* Adjust docs
2025-08-16 10:20:33 -05:00
Nicolas Mowen
7740b08bd9
Add ability to pass additional args to Ollama ( #19484 )
...
* Call out recognized objects more specifically
* Cleanup
* Make keep_alive and options configurable
* Generalize
* Use for other providers
2025-08-16 10:20:33 -05:00
Nicolas Mowen
dace88bfce
Genai review summaries ( #19473 )
...
* Generate review item summaries with requests
* Adjust logic to only send important items
* Don't mention ladder
* Adjust prompt to be more specific
* Add more relaxed nature for normal activity
* Cleanup summary
* Update ollama client
* Add more directions to analyze the frames in order
* Remove environment from prompt
2025-08-16 10:20:33 -05:00
markfrancisonly
8e663413bb
Added total camera fps, total processed fps, and total skipped fps to stats api ( #19469 )
...
Co-authored-by: Mark Francis <markfrancisonly@gmail.com>
2025-08-16 10:20:33 -05:00
Nicolas Mowen
cc18d7f786
Add config for users to define additional concerns that GenAI should make note of in review summary ( #19463 )
...
* Don't default to openai
* Improve UI
* Allow configuring additional concerns that users may want the AI to note
* Formatting
* Add preferred language config
* Remove unused
2025-08-16 10:20:33 -05:00
Nicolas Mowen
3cf86767f1
Use preview frames for Review Descriptions ( #19450 )
...
* Use preview frames for genai
* Cleanup
* Adjust
2025-08-16 10:20:33 -05:00
Nicolas Mowen
92417a1b9c
Review genai updates ( #19448 )
...
* Include extra level for normal activity
* Add dynamic toggling
* Update docs
* Add different threshold for genai
* Adjust webUI for object and review description feature
* Adjust config
* Send on startup
* Cleanup config setting
* Set config
* Fix config name
2025-08-16 10:20:33 -05:00
Nicolas Mowen
2cf8dd693c
Review Item GenAI metadata ( #19442 )
...
* Rename existing function
* Keep track of thumbnial updates
* Tinkering with genai prompt
* Adjust input format
* Create model for review description output
* testing prompt changes
* Prompt improvements and image saving
* Add config for review items genai
* Use genai review config
* Actual config usage
* Adjust debug image saving
* Fix
* Fix review creation
* Adjust prompt
* Prompt adjustment
* Run genai in thread
* Fix detections block
* Adjust prompt
* Prompt changes
* Save genai response to metadata model
* Handle metadata
* Send review update to dispatcher
* Save review metadata to DB
* Send review notification updates
* Quick fix
* Fix name
* Fix update type
* Correctly dump model
* Add card
* Add card
* Remove message
* Cleanup typing and UI
* Adjust prompt
* Formatting
* Add log
* Formatting
* Add inference speed and keep alive
2025-08-16 10:20:33 -05:00
Nicolas Mowen
1f3755e45d
Migrate object genai configuration ( #19437 )
...
* Move genAI object to objects section
* Adjust config propogation behavior
* Refactor genai config usage
* Automatic migration
* Always start the embeddings process
* Always init embeddings
* Config fixes
* Adjust reference config
* Adjust docs
* Formatting
* Fix
2025-08-16 10:20:33 -05:00
Nicolas Mowen
7c1681e344
Enable mypy for DB and fix types ( #19434 )
...
* Install peewee type hints
* Models now have proper types
* Fix iterator type
* Enable debug builds with dev reqs installed
* Install as wheel
* Fix cast type
2025-08-16 10:20:33 -05:00
Nicolas Mowen
6ecc631486
Adjust loitering behavior based on object type ( #19433 )
...
* Adjust loitering behavior based on object
* Update docs
* Grammar
2025-08-16 10:20:33 -05:00
Nicolas Mowen
fcf3824124
Improve comms typing ( #18599 )
...
* Enable mypy for comms
* Make zmq data types consistent
* Cleanup inter process typing issues
* Cleanup embeddings typing
* Cleanup config updater
* Cleanup recordings updator
* Make publisher have a generic type
* Cleanup event metadata updater
* Cleanup event metadata updater
* Cleanup detections updater
* Cleanup websocket
* Cleanup mqtt
* Cleanup webpush
* Cleanup dispatcher
* Formatting
* Remove unused
* Add return type
* Fix tests
* Fix semantic triggers config typing
* Cleanup
2025-08-16 10:20:33 -05:00
Nicolas Mowen
e9e3c481b2
Implement start for review item description processor ( #19352 )
...
* Add review item data transmission
* Publish review updates
* Add review item subscriber
* Basic implementation for testing review processor
* Formatting
2025-08-16 10:20:33 -05:00
Nicolas Mowen
fa1b88097b
Improve the tablet layout ( #19320 )
...
* Improve the tablet layout
* Update imports sort
* Fix more imports
2025-08-16 10:20:33 -05:00
Nicolas Mowen
20104761e8
Require setting process priority for FrigateProcess ( #19207 )
2025-08-16 10:20:33 -05:00
Nicolas Mowen
d071325ca7
Object attribute classification ( #19205 )
...
* Add enum for type of classification for objects
* Update recognized license plate topic to be used as attribute updater
* Update attribute for attribute type object classification
* Cleanup
2025-08-16 10:20:33 -05:00
Nicolas Mowen
55e5a55fa2
Classification train updates ( #19173 )
...
* Improve model train button
* Add filters for classification
* Cleanup
* Don't run classification on false positives
* Cleanup filter
* Fix icon color
2025-08-16 10:20:33 -05:00
Josh Hawkins
8719216fa6
Dynamically enable/disable GenAI ( #19139 )
...
* config
* dispatcher and mqtt
* docs
* use config updater
* add switch to frontend
2025-08-16 10:20:33 -05:00
Josh Hawkins
22478df4d6
Optionally show tracked object paths in debug view ( #19025 )
2025-08-16 10:20:33 -05:00
Josh Hawkins
3609b41217
Semantic Search Triggers ( #18969 )
...
* semantic trigger test
* database and model
* config
* embeddings maintainer and trigger post-processor
* api to create, edit, delete triggers
* frontend and i18n keys
* use thumbnail and description for trigger types
* image picker tweaks
* initial sync
* thumbnail file management
* clean up logs and use saved thumbnail on frontend
* publish mqtt messages
* webpush changes to enable trigger notifications
* add enabled switch
* add triggers from explore
* renaming and deletion fixes
* fix typing
* UI updates and add last triggering event time and link
* log exception instead of return in endpoint
* highlight entry in UI when triggered
* save and delete thumbnails directly
* remove alert action for now and add descriptions
* tweaks
* clean up
* fix types
* docs
* docs tweaks
* docs
* reuse enum
2025-08-16 10:20:33 -05:00
Nicolas Mowen
28f816b49a
Classification improvements ( #19020 )
...
* Move classification training to full process
* Sort class images
2025-08-16 10:20:33 -05:00
Nicolas Mowen
528f0d2b1f
Improve classification UI ( #18910 )
...
* Move threhsold to base model config
* Improve score handling
* Add back button
2025-08-16 10:20:33 -05:00
Nicolas Mowen
f925154b8a
Remove TFLite init logs
2025-08-16 10:20:33 -05:00
Nicolas Mowen
13fb7bc260
Improve object classification ( #18908 )
...
* Ui improvements
* Improve image cropping and model saving
* Improve naming
* Add logs for training
* Improve model labeling
* Don't set sub label for none object classification
* Cleanup
2025-08-16 10:20:33 -05:00
Nicolas Mowen
ceeb6543f5
0.17 tweaks ( #18892 )
...
* Set version
* Cleanup more logs
* Don't log matplotlib
2025-08-16 10:20:33 -05:00
Josh Hawkins
cf62bee170
Add ONVIF focus support ( #18883 )
...
* backend
* frontend and i18n
2025-08-16 10:20:33 -05:00
Nicolas Mowen
ec6c04e49a
Improve logging ( #18867 )
...
* Ignore numpy get limits warning
* Add function wrapper to redirect stdout and stderr to logpipe
* Save stderr too
* Add more to catch
* run logpipe
* Use other logging redirect class
* Use other logging redirect class
* add decorator for redirecting c/c++ level output to logger
* fix typing
---------
Co-authored-by: Josh Hawkins <32435876+hawkeye217@users.noreply.github.com>
2025-08-16 10:20:33 -05:00
Josh Hawkins
da0248db15
Don't try to close or join mp manager queues ( #18866 )
...
Multiprocessing Manager queues don't have a close() or join_thread() method, and the Manager will clean it up appropriately after we empty it. This prevents an infinite loop when an AttributeError exception fires for Manager AutoProxy queue objects.
2025-08-16 10:20:33 -05:00
Nicolas Mowen
542bf05bb8
Handle SIGINT with forkserver ( #18860 )
...
* Pass stopevent from main start
* Share stop event across processes
* preload modules
* remove explicit os._exit call
---------
Co-authored-by: Josh Hawkins <32435876+hawkeye217@users.noreply.github.com>
2025-08-16 10:20:33 -05:00
Nicolas Mowen
e1ee6f010f
Fix process name
2025-08-16 10:20:33 -05:00
Josh Hawkins
9c2ba152e1
Catch invalid character index in lpr CTC decoder ( #18825 )
2025-08-16 10:20:33 -05:00
Josh Hawkins
7c8164aa99
Fix birdseye crash when dynamically adding a camera ( #18821 )
2025-08-16 10:20:33 -05:00
Nicolas Mowen
847b03e71b
Catch unpickling error
2025-08-16 10:20:33 -05:00
Nicolas Mowen
0d5a49ab82
Don't fail on unicode debug for config updates
2025-08-16 10:20:33 -05:00