Josh Hawkins
4c12673fbb
Add ability to restrict genai to objects and zones at the camera level ( #13958 )
...
* Add ability to restrict genai to labels and zones at the camera level
* fix comment
* clarify docs
* use objects instead of labels
* docs
* object list
2024-09-25 09:42:39 -06:00
Josh Hawkins
a7f1f8d327
Add 1s timeout to metadata subscriber in embeddings maintainer ( #13947 )
2024-09-24 19:08:12 -05:00
Josh Hawkins
ecbf0410eb
Regenerate genai tracked object descriptions ( #13930 )
...
* add genai to frigateconfig
* add regenerate button if genai is enabled
* add endpoint and new zmq pub/sub model
* move publisher to app
* dont override
* logging
* debug timeouts
* clean up
* clean up
* allow saving of empty description
* ensure descriptions can be empty
* update search detail when results change
* revalidate explore page on focus
* global mutate hook
* description websocket hook and dispatcher
* revalidation and mutation
* fix merge conflicts
* update tests
* fix merge conflicts
* fix response message
* fix response message
* fix fastapi
* fix test
* remove log
* json content
* fix content response
* more json content fixes
* another one
2024-09-24 08:14:51 -06:00
Josh Hawkins
0f813962be
Chroma fixes ( #13902 )
...
* Ensure descriptions saved in chroma are non-empty
* delete only existing ids in event cleanup
* add debug logging
2024-09-23 06:53:19 -06:00
Nicolas Mowen
e44a9e8921
Use cpu provider for embeddings models ( #13806 )
2024-09-17 17:20:18 -05:00
Nicolas Mowen
1ed8642010
Refactor onnx providers ( #13804 )
...
* Ensure dirs exist for model caches
* Formatting
* Don't use tensorrt for embeddings
2024-09-17 15:54:44 -05:00
Nicolas Mowen
2362d0e838
Override onnx clip loading ( #13800 )
...
* Set caching options for hardware providers
* Always use CPU for searching
* Use new install strategy to remove onnxruntime and then install post wheels
2024-09-17 13:24:35 -06:00
gtsiam
edababa88e
Work through most of the cspell warnings in python ( #13794 )
2024-09-17 10:41:46 -05:00
Josh Hawkins
e3edcf057c
write prompts for genai at the camera level ( #13767 )
2024-09-16 08:46:11 -06:00
Nicolas Mowen
9afa1354da
Limit shm frame count ( #12363 )
...
* Limited shm frame count (#12346 )
* Only keep 2x detect fps frames in SHM
* Don't delete previous shm frames in output
* Catch case where images do not exist
* Ensure files are closed
* Clear out all frames when shutting down
* Correct the number of frames saved
* Simplify empty shm error handling
* Improve frame safety
* Add handler logs when frame is None
* Don't fail on cleanup
* Cleanup logging
* Update docs
* Update calculation
* Restore condition
* Fix case where thumbnail is saved without frame
* Adjust debug logs
* Calculate best shm frame count
* Fix shm count calculation
* Catch missing frame
* Formatting
* Clarify docs
* Catch none frame in autotracking
2024-09-03 10:22:30 -06:00
Jason Hunter
0d7a148897
reindex events in batches to reduce memory and cpu load ( #12124 )
2024-08-29 20:19:50 -06:00
Jason Hunter
9e825811f2
Semantic Search API ( #12105 )
...
* initial event search api implementation
* fix lint
* fix tests
* move chromadb imports and pysqlite hotswap to fix tests
* remove unused import
* switch default limit to 50
* fix events accidently pulling inside chroma results loop
2024-08-29 20:19:50 -06:00
Jason Hunter
36cbffcc5e
Semantic Search for Detections ( #11899 )
...
* Initial re-implementation of semantic search
* put docker-compose back and make reindex match docs
* remove debug code and fix import
* fix docs
* manually build pysqlite3 as binaries are only available for x86-64
* update comment in build_pysqlite3.sh
* only embed objects
* better error handling when genai fails
* ask ollama to pull requested model at startup
* update ollama docs
* address some PR review comments
* fix lint
* use IPC to write description, update docs for reindex
* remove gemini-pro-vision from docs as it will be unavailable soon
* fix OpenAI doc available models
* fix api error in gemini and metadata for embeddings
2024-08-29 20:19:50 -06:00
