16 Commits

Author	SHA1	Message	Date
Josh Hawkins	95d6da3111	Add ability to configure genai to use snapshot instead of thumbnails (#14077) ... * Allow embedding of snapshot for description via config option * docs * frontend button * Backend * crop snapshot to region * only show dropdown when event has snapshot * fix cursor on dropdown * crop on initial generation as well * use enum for type * fix type	2024-09-30 15:54:53 -06:00
Josh Hawkins	40fe3b4358	Search functionality and UI tweaks (#13978) ... * Portal tooltips * Add ability to time_range filter chroma searches * centering and padding consistency * add event id back to chroma metadata * query sqlite first and pass those ids to chroma for embeddings search * ensure we pass timezone to the api call * remove object lifecycle from search details for non-object events * simplify hour calculation * fix query without filters * bump chroma version * chroma 0.5.7 * fix selecting camera group in cameras filter button	2024-09-26 15:30:56 -05:00
Josh Hawkins	ae547d27e4	Use not instead of is None (#13962)	2024-09-25 11:53:25 -06:00
Josh Hawkins	4c12673fbb	Add ability to restrict genai to objects and zones at the camera level (#13958) ... * Add ability to restrict genai to labels and zones at the camera level * fix comment * clarify docs * use objects instead of labels * docs * object list	2024-09-25 09:42:39 -06:00
Josh Hawkins	a7f1f8d327	Add 1s timeout to metadata subscriber in embeddings maintainer (#13947)	2024-09-24 19:08:12 -05:00
Josh Hawkins	ecbf0410eb	Regenerate genai tracked object descriptions (#13930) ... * add genai to frigateconfig * add regenerate button if genai is enabled * add endpoint and new zmq pub/sub model * move publisher to app * dont override * logging * debug timeouts * clean up * clean up * allow saving of empty description * ensure descriptions can be empty * update search detail when results change * revalidate explore page on focus * global mutate hook * description websocket hook and dispatcher * revalidation and mutation * fix merge conflicts * update tests * fix merge conflicts * fix response message * fix response message * fix fastapi * fix test * remove log * json content * fix content response * more json content fixes * another one	2024-09-24 08:14:51 -06:00
Josh Hawkins	0f813962be	Chroma fixes (#13902) ... * Ensure descriptions saved in chroma are non-empty * delete only existing ids in event cleanup * add debug logging	2024-09-23 06:53:19 -06:00
Nicolas Mowen	e44a9e8921	Use cpu provider for embeddings models (#13806)	2024-09-17 17:20:18 -05:00
Nicolas Mowen	1ed8642010	Refactor onnx providers (#13804) ... * Ensure dirs exist for model caches * Formatting * Don't use tensorrt for embeddings	2024-09-17 15:54:44 -05:00
Nicolas Mowen	2362d0e838	Override onnx clip loading (#13800) ... * Set caching options for hardware providers * Always use CPU for searching * Use new install strategy to remove onnxruntime and then install post wheels	2024-09-17 13:24:35 -06:00
gtsiam	edababa88e	Work through most of the cspell warnings in python (#13794)	2024-09-17 10:41:46 -05:00
Josh Hawkins	e3edcf057c	write prompts for genai at the camera level (#13767)	2024-09-16 08:46:11 -06:00
Nicolas Mowen	9afa1354da	Limit shm frame count (#12363) ... * Limited shm frame count (#12346) * Only keep 2x detect fps frames in SHM * Don't delete previous shm frames in output * Catch case where images do not exist * Ensure files are closed * Clear out all frames when shutting down * Correct the number of frames saved * Simplify empty shm error handling * Improve frame safety * Add handler logs when frame is None * Don't fail on cleanup * Cleanup logging * Update docs * Update calculation * Restore condition * Fix case where thumbnail is saved without frame * Adjust debug logs * Calculate best shm frame count * Fix shm count calculation * Catch missing frame * Formatting * Clarify docs * Catch none frame in autotracking	2024-09-03 10:22:30 -06:00
Jason Hunter	0d7a148897	reindex events in batches to reduce memory and cpu load (#12124)	2024-08-29 20:19:50 -06:00
Jason Hunter	9e825811f2	Semantic Search API (#12105) ... * initial event search api implementation * fix lint * fix tests * move chromadb imports and pysqlite hotswap to fix tests * remove unused import * switch default limit to 50 * fix events accidently pulling inside chroma results loop	2024-08-29 20:19:50 -06:00
Jason Hunter	36cbffcc5e	Semantic Search for Detections (#11899) ... * Initial re-implementation of semantic search * put docker-compose back and make reindex match docs * remove debug code and fix import * fix docs * manually build pysqlite3 as binaries are only available for x86-64 * update comment in build_pysqlite3.sh * only embed objects * better error handling when genai fails * ask ollama to pull requested model at startup * update ollama docs * address some PR review comments * fix lint * use IPC to write description, update docs for reindex * remove gemini-pro-vision from docs as it will be unavailable soon * fix OpenAI doc available models * fix api error in gemini and metadata for embeddings	2024-08-29 20:19:50 -06:00