Josh Hawkins
22e981c38c
Add role map support for proxy auth ( #19758 )
...
* update config
* add role map support
* docs
2025-08-25 17:58:41 -05:00
Nicolas Mowen
ed9d031e80
Add experimental support for AMD AMF decode/encode ( #19745 )
...
* Add experimental support for AMD AMF decode/encode
* Organize imports
2025-08-25 13:40:36 -05:00
Josh Hawkins
c260642604
Improve audio detection debugging ( #19753 )
...
* create audio activity manager
move publishing logic out of audio detector
* dispatcher changes
* correctly publish full array of audio detections in onConnect
* frontend websocket hooks
* line graph
* debug tab and i18n
* docs
* clean up
* fix i18n key
2025-08-25 13:40:21 -05:00
Nicolas Mowen
4fcb1ea7ac
Unload HLS on unmount ( #19747 )
...
* Unload HLS player on unmount so segments don't continue to load
* Add query arg for event padding
2025-08-25 13:33:17 -05:00
Josh Hawkins
1636fee36a
Only try to import memryx SDK when memry detector is used ( #19737 )
2025-08-24 18:38:30 -05:00
Josh Hawkins
a88760efa1
Display warning in frontend if shm size is too low ( #19712 )
...
* backend
refactor shm calculation to utility function so it can be used in frontend stats
* frontend
* fix check
* clean up
2025-08-22 13:48:27 -06:00
Tim Wesley
dbceb4dcc7
MemryX MX3 detector integration ( #17723 )
...
* sdk_2.0_update
* memryx docs: minor reorg
* ran ruff
* whoops, more ruff fixes
* Fixes (#6 )
* Fixes and custom model path updated
* ruff formatting
* removed apt install from main
* add comment about libgomp1 in install_deps
---------
Co-authored-by: Abinila Siva <abinila.siva@memryx.com >
Co-authored-by: Abinila Siva <163017635+abinila4@users.noreply.github.com >
2025-08-22 08:11:48 -05:00
Nicolas Mowen
9dd7ead462
Camera Health Status ( #19709 )
...
* Send status of camera streams to mqtt
* Update docs
* Formatting
* Fix frontend querying fps
2025-08-22 06:42:36 -06:00
Josh Hawkins
4fe246f472
Fixes ( #19708 )
...
* use custom swr fetcher to check for audio support
The go2rtc API doesn't always return stream data for anything not being actively consumed, so audio support was not always being correctly deduced. So we can use a custom swr fetcher to call the endpoint that probes the streams, which returns the correct producers data.
* return correct mime type for thumbnail and latest frame endpoints
follow up to https://github.com/blakeblackshear/frigate/pull/19555
2025-08-22 07:04:30 -05:00
Nicolas Mowen
539c760953
Don't print when not using rknn ( #19698 )
...
* Debug logs for rknn embeddings check
* Debug logs for rknn embeddings check
2025-08-21 18:00:36 -05:00
Nicolas Mowen
f39475a383
Support face recognition via RKNN ( #19687 )
...
* Add support for face recognition via RKNN
* Fix crash when adding camera in via UI
* Update docs regarding support for face recognition
* Formatting
2025-08-21 06:18:55 -06:00
Nicolas Mowen
1be84d6833
Add automatic RKNN conversion and support for semantic search model ( #19676 )
...
* Create RKNN model runner and and use for jina v1 clip
* Formatting
* Handle model type inference
* Properly provide input to RKNN
* Adjust rknn conversion
* Update docs
* Formatting
* Fix path handling
* Handle inputs
* Cleanup
* Change normalization for better accuracy
* Clarify supported models
* Remove testing
2025-08-21 05:30:14 -06:00
Nicolas Mowen
2236ecf23f
Auto convert ONNX models to RKNN format ( #19674 )
...
* Implement base rknn conversion
* Remove unused
* Formatting
* Add model conversion lock so it doesn't break when multiple detectors are defined
* Ignore unused impor
t
2025-08-20 15:15:57 -06:00
Nicolas Mowen
6e3b40eaee
Fix record motion config ( #19672 )
...
* fix record config
* Formatting
2025-08-20 14:45:17 -06:00
Josh Hawkins
75e33d8a56
Catch invalid key in genai prompt ( #19657 )
2025-08-20 08:03:50 -05:00
Nicolas Mowen
9fb09408d1
Fix build ( #19634 )
...
* Don't put special constraints
* Undo joserfc install
* Fix joserfc
* Formatting
2025-08-19 13:19:31 -06:00
Nicolas Mowen
e92267d7e2
Update deps ( #19617 )
...
* Update virtualenv
* Fix device ID
* Fix dependency conflict
* Cleanup mypy
2025-08-19 11:08:34 -05:00
Nicolas Mowen
acf32e1a1e
Various Fixes ( #19615 )
...
* Don't write to write None response to file
* fix genai config migration
* Fix JP6 build
* Include base image ARG
2025-08-19 06:49:55 -06:00
Josh Hawkins
d27e8c1bbf
run autotracking setup method in asyncio coroutine ( #19614 )
2025-08-19 07:07:24 -05:00
baudneo
33f3ea3b59
Enrichments: Allow targeting a specific GPU ID ( #19342 )
2025-08-18 17:43:53 -06:00
scyto
83e9ae616a
Enable Optional IPv6 Support for Nginx ( #19602 )
2025-08-18 17:39:12 -06:00
Josh Hawkins
353ee1228c
Return 500 from the face registration endpoint if Frigate has not yet been restarted ( #19601 )
2025-08-18 14:49:50 -06:00
Nicolas Mowen
152d9ed4a0
Apple Silicon / ZMQ Detector ( #19592 )
...
* Add zmq detector
* Cleanup
* Logging
* Cleanup
* Cleanup
* Add to hardware docs
* Add apple silicon to docs
* Formatting
2025-08-18 09:51:12 -05:00
Josh Hawkins
ba20b61c43
Deprecate API field include_thumbnails ( #19584 )
...
* Add deprecation note to API docs for include_thumbnails
* for search query params as well
2025-08-18 08:26:02 -05:00
Josh Hawkins
9ed7ccab75
Embeddings maintainer should start if bird classification is enabled ( #19576 )
2025-08-17 19:48:21 -06:00
Josh Hawkins
1db26cb41e
Ensure birdseye is enabled before trying to grab a frame from it ( #19573 )
2025-08-17 17:26:18 -06:00
Nicolas Mowen
5a49d1f73c
Enable mypy for track and fix typing errors ( #19529 )
...
* Enable mypy for track
* WIP cleaning up tracked object
* Fix tracked object typing
* Fix typing and imports of centroid tracker
* Cleanup typing
* Cleanup
* Formatting
* Fix imports
* Don't specify callable type
* Type out json setting
2025-08-17 12:27:42 -05:00
Josh Hawkins
6840415b6c
Fix content type for latest image API endpoint ( #19555 )
...
* Fix content type for latest image API endpoint
Extension is an enum and .value needed to be appended. Additionally, fastapi's Response() automatically sets the content type when media_type is specified, so a Content-Type in the headers was redundant.
* Remove another unneeded Content-Type
2025-08-16 21:20:21 -06:00
Nicolas Mowen
856aab8e6e
Cleanup filename sanitization
2025-08-16 10:20:33 -05:00
Nicolas Mowen
ccbaa74a8b
Improve natural language of prompt ( #19515 )
...
* Make sequence details human-readable so they are used in natural language response
* Cleanup
* Improve prompt and image selection
* Adjust
* Adjust sligtly
* Format time
* Adjust frame selection logic
* Debug save response
* Ignore extra fields
* Adjust docs
2025-08-16 10:20:33 -05:00
Nicolas Mowen
7740b08bd9
Add ability to pass additional args to Ollama ( #19484 )
...
* Call out recognized objects more specifically
* Cleanup
* Make keep_alive and options configurable
* Generalize
* Use for other providers
2025-08-16 10:20:33 -05:00
Nicolas Mowen
dace88bfce
Genai review summaries ( #19473 )
...
* Generate review item summaries with requests
* Adjust logic to only send important items
* Don't mention ladder
* Adjust prompt to be more specific
* Add more relaxed nature for normal activity
* Cleanup summary
* Update ollama client
* Add more directions to analyze the frames in order
* Remove environment from prompt
2025-08-16 10:20:33 -05:00
markfrancisonly
8e663413bb
Added total camera fps, total processed fps, and total skipped fps to stats api ( #19469 )
...
Co-authored-by: Mark Francis <markfrancisonly@gmail.com >
2025-08-16 10:20:33 -05:00
Nicolas Mowen
cc18d7f786
Add config for users to define additional concerns that GenAI should make note of in review summary ( #19463 )
...
* Don't default to openai
* Improve UI
* Allow configuring additional concerns that users may want the AI to note
* Formatting
* Add preferred language config
* Remove unused
2025-08-16 10:20:33 -05:00
Nicolas Mowen
3cf86767f1
Use preview frames for Review Descriptions ( #19450 )
...
* Use preview frames for genai
* Cleanup
* Adjust
2025-08-16 10:20:33 -05:00
Nicolas Mowen
92417a1b9c
Review genai updates ( #19448 )
...
* Include extra level for normal activity
* Add dynamic toggling
* Update docs
* Add different threshold for genai
* Adjust webUI for object and review description feature
* Adjust config
* Send on startup
* Cleanup config setting
* Set config
* Fix config name
2025-08-16 10:20:33 -05:00
Nicolas Mowen
2cf8dd693c
Review Item GenAI metadata ( #19442 )
...
* Rename existing function
* Keep track of thumbnial updates
* Tinkering with genai prompt
* Adjust input format
* Create model for review description output
* testing prompt changes
* Prompt improvements and image saving
* Add config for review items genai
* Use genai review config
* Actual config usage
* Adjust debug image saving
* Fix
* Fix review creation
* Adjust prompt
* Prompt adjustment
* Run genai in thread
* Fix detections block
* Adjust prompt
* Prompt changes
* Save genai response to metadata model
* Handle metadata
* Send review update to dispatcher
* Save review metadata to DB
* Send review notification updates
* Quick fix
* Fix name
* Fix update type
* Correctly dump model
* Add card
* Add card
* Remove message
* Cleanup typing and UI
* Adjust prompt
* Formatting
* Add log
* Formatting
* Add inference speed and keep alive
2025-08-16 10:20:33 -05:00
Nicolas Mowen
1f3755e45d
Migrate object genai configuration ( #19437 )
...
* Move genAI object to objects section
* Adjust config propogation behavior
* Refactor genai config usage
* Automatic migration
* Always start the embeddings process
* Always init embeddings
* Config fixes
* Adjust reference config
* Adjust docs
* Formatting
* Fix
2025-08-16 10:20:33 -05:00
Nicolas Mowen
7c1681e344
Enable mypy for DB and fix types ( #19434 )
...
* Install peewee type hints
* Models now have proper types
* Fix iterator type
* Enable debug builds with dev reqs installed
* Install as wheel
* Fix cast type
2025-08-16 10:20:33 -05:00
Nicolas Mowen
6ecc631486
Adjust loitering behavior based on object type ( #19433 )
...
* Adjust loitering behavior based on object
* Update docs
* Grammar
2025-08-16 10:20:33 -05:00
Nicolas Mowen
fcf3824124
Improve comms typing ( #18599 )
...
* Enable mypy for comms
* Make zmq data types consistent
* Cleanup inter process typing issues
* Cleanup embeddings typing
* Cleanup config updater
* Cleanup recordings updator
* Make publisher have a generic type
* Cleanup event metadata updater
* Cleanup event metadata updater
* Cleanup detections updater
* Cleanup websocket
* Cleanup mqtt
* Cleanup webpush
* Cleanup dispatcher
* Formatting
* Remove unused
* Add return type
* Fix tests
* Fix semantic triggers config typing
* Cleanup
2025-08-16 10:20:33 -05:00
Nicolas Mowen
e9e3c481b2
Implement start for review item description processor ( #19352 )
...
* Add review item data transmission
* Publish review updates
* Add review item subscriber
* Basic implementation for testing review processor
* Formatting
2025-08-16 10:20:33 -05:00
Nicolas Mowen
fa1b88097b
Improve the tablet layout ( #19320 )
...
* Improve the tablet layout
* Update imports sort
* Fix more imports
2025-08-16 10:20:33 -05:00
Nicolas Mowen
20104761e8
Require setting process priority for FrigateProcess ( #19207 )
2025-08-16 10:20:33 -05:00
Nicolas Mowen
d071325ca7
Object attribute classification ( #19205 )
...
* Add enum for type of classification for objects
* Update recognized license plate topic to be used as attribute updater
* Update attribute for attribute type object classification
* Cleanup
2025-08-16 10:20:33 -05:00
Nicolas Mowen
55e5a55fa2
Classification train updates ( #19173 )
...
* Improve model train button
* Add filters for classification
* Cleanup
* Don't run classification on false positives
* Cleanup filter
* Fix icon color
2025-08-16 10:20:33 -05:00
Josh Hawkins
8719216fa6
Dynamically enable/disable GenAI ( #19139 )
...
* config
* dispatcher and mqtt
* docs
* use config updater
* add switch to frontend
2025-08-16 10:20:33 -05:00
Josh Hawkins
22478df4d6
Optionally show tracked object paths in debug view ( #19025 )
2025-08-16 10:20:33 -05:00
Josh Hawkins
3609b41217
Semantic Search Triggers ( #18969 )
...
* semantic trigger test
* database and model
* config
* embeddings maintainer and trigger post-processor
* api to create, edit, delete triggers
* frontend and i18n keys
* use thumbnail and description for trigger types
* image picker tweaks
* initial sync
* thumbnail file management
* clean up logs and use saved thumbnail on frontend
* publish mqtt messages
* webpush changes to enable trigger notifications
* add enabled switch
* add triggers from explore
* renaming and deletion fixes
* fix typing
* UI updates and add last triggering event time and link
* log exception instead of return in endpoint
* highlight entry in UI when triggered
* save and delete thumbnails directly
* remove alert action for now and add descriptions
* tweaks
* clean up
* fix types
* docs
* docs tweaks
* docs
* reuse enum
2025-08-16 10:20:33 -05:00
Nicolas Mowen
28f816b49a
Classification improvements ( #19020 )
...
* Move classification training to full process
* Sort class images
2025-08-16 10:20:33 -05:00