3 Commits

Author	SHA1	Message	Date
Jason Hunter	0d7a148897	reindex events in batches to reduce memory and cpu load (#12124)	2024-08-29 20:19:50 -06:00
Jason Hunter	9e825811f2	Semantic Search API (#12105) ... * initial event search api implementation * fix lint * fix tests * move chromadb imports and pysqlite hotswap to fix tests * remove unused import * switch default limit to 50 * fix events accidently pulling inside chroma results loop	2024-08-29 20:19:50 -06:00
Jason Hunter	36cbffcc5e	Semantic Search for Detections (#11899) ... * Initial re-implementation of semantic search * put docker-compose back and make reindex match docs * remove debug code and fix import * fix docs * manually build pysqlite3 as binaries are only available for x86-64 * update comment in build_pysqlite3.sh * only embed objects * better error handling when genai fails * ask ollama to pull requested model at startup * update ollama docs * address some PR review comments * fix lint * use IPC to write description, update docs for reindex * remove gemini-pro-vision from docs as it will be unavailable soon * fix OpenAI doc available models * fix api error in gemini and metadata for embeddings	2024-08-29 20:19:50 -06:00