blakeblackshear.frigate/frigate
Josh Hawkins 24ac9f3e5a
Use sqlite-vec extension instead of chromadb for embeddings (#14163)
* swap sqlite_vec for chroma in requirements

* load sqlite_vec in embeddings manager

* remove chroma and revamp Embeddings class for sqlite_vec

* manual minilm onnx inference

* remove chroma in clip model

* migrate api from chroma to sqlite_vec

* migrate event cleanup from chroma to sqlite_vec

* migrate embedding maintainer from chroma to sqlite_vec

* genai description for sqlite_vec

* load sqlite_vec in main thread db

* extend the SqliteQueueDatabase class and use peewee db.execute_sql

* search with Event type for similarity

* fix similarity search

* install and add comment about transformers

* fix normalization

* add id filter

* clean up

* clean up

* fully remove chroma and add transformers env var

* readd uvicorn for fastapi

* readd tokenizer parallelism env var

* remove chroma from docs

* remove chroma from UI

* try removing custom pysqlite3 build

* hard code limit

* optimize queries

* revert explore query

* fix query

* keep building pysqlite3

* single pass fetch and process

* remove unnecessary re-embed

* update deps

* move SqliteVecQueueDatabase to db directory

* make search thumbnail take up full size of results box

* improve typing

* improve model downloading and add status screen

* daemon downloading thread

* catch case when semantic search is disabled

* fix typing

* build sqlite_vec from source

* resolve conflict

* file permissions

* try build deps

* remove sources

* sources

* fix thread start

* include git in build

* reorder embeddings after detectors are started

* build with sqlite amalgamation

* non-platform specific

* use wget instead of curl

* remove unzip -d

* remove sqlite_vec from requirements and load the compiled version

* fix build

* avoid race in db connection

* add scale_factor and bias to description zscore normalization
2024-10-07 14:30:45 -06:00
..
api Use sqlite-vec extension instead of chromadb for embeddings (#14163) 2024-10-07 14:30:45 -06:00
camera Custom classes for Process and Metrics (#13950) 2024-09-27 07:53:23 -05:00
comms Use sqlite-vec extension instead of chromadb for embeddings (#14163) 2024-10-07 14:30:45 -06:00
config Fix logging (#14122) 2024-10-03 06:33:53 -06:00
db Use sqlite-vec extension instead of chromadb for embeddings (#14163) 2024-10-07 14:30:45 -06:00
detectors Log correct tensorRT version when debugging (#14182) 2024-10-06 15:33:03 -06:00
embeddings Use sqlite-vec extension instead of chromadb for embeddings (#14163) 2024-10-07 14:30:45 -06:00
events Use sqlite-vec extension instead of chromadb for embeddings (#14163) 2024-10-07 14:30:45 -06:00
genai Use sqlite-vec extension instead of chromadb for embeddings (#14163) 2024-10-07 14:30:45 -06:00
images Replace green screen with error message and force camera_fps to 0 (#4544) 2022-11-28 21:47:20 -06:00
motion Work through most of the cspell warnings in python (#13794) 2024-09-17 10:41:46 -05:00
output Properly call super() in subclasses (#14124) 2024-10-02 19:35:46 -06:00
ptz Fix autotracking absolute zoom interpolation logic (#14139) 2024-10-03 08:40:27 -05:00
record Properly call super() in subclasses (#14124) 2024-10-02 19:35:46 -06:00
review Properly call super() in subclasses (#14124) 2024-10-02 19:35:46 -06:00
stats Properly call super() in subclasses (#14124) 2024-10-02 19:35:46 -06:00
test Refactor attribute saving (#14090) 2024-10-01 07:31:03 -06:00
track Refactor attribute saving (#14090) 2024-10-01 07:31:03 -06:00
util Use sqlite-vec extension instead of chromadb for embeddings (#14163) 2024-10-07 14:30:45 -06:00
__init__.py app container and config schema 2021-01-26 21:40:33 -06:00
__main__.py Split config.py into multiple files (#14038) 2024-09-28 14:21:42 -05:00
app.py Use sqlite-vec extension instead of chromadb for embeddings (#14163) 2024-10-07 14:30:45 -06:00
const.py Use sqlite-vec extension instead of chromadb for embeddings (#14163) 2024-10-07 14:30:45 -06:00
ffmpeg_presets.py Bug Fixes (#14193) 2024-10-07 07:18:09 -06:00
log.py Properly call super() in subclasses (#14124) 2024-10-02 19:35:46 -06:00
models.py Implement support for notifications (#12523) 2024-08-29 20:19:50 -06:00
mypy.ini update deps (#6093) 2023-04-15 14:17:59 -05:00
object_detection.py Improve rocm handling of different models (#14072) 2024-09-30 16:40:46 -05:00
object_processing.py Properly call super() in subclasses (#14124) 2024-10-02 19:35:46 -06:00
plus.py strip whitespaces when loading secrets (#12393) 2024-07-12 07:36:15 -06:00
storage.py Properly call super() in subclasses (#14124) 2024-10-02 19:35:46 -06:00
timeline.py Properly call super() in subclasses (#14124) 2024-10-02 19:35:46 -06:00
types.py Use sqlite-vec extension instead of chromadb for embeddings (#14163) 2024-10-07 14:30:45 -06:00
video.py Fix shared memory frames being stuck when a camera capture crashed (#14140) 2024-10-03 09:31:07 -06:00
watchdog.py Properly call super() in subclasses (#14124) 2024-10-02 19:35:46 -06:00