Josh Hawkins
8364e68667
Model and genai fixes ( #14481 )
...
* disable mem arena in options for cpu only
* add try/except around ollama initialization
* update docs
2024-10-21 09:00:45 -06:00
Josh Hawkins
6c70e56059
Misc bugfixes and improvements ( #14460 )
...
* only save a fixed number of thumbnails if genai is enabled
* disable cpu_mem_arena to save on memory until its actually needed
* fix search settings pane so it actually saves to the config
2024-10-20 14:14:51 -06:00
Nicolas Mowen
9adffa1ef5
Detection adjustments ( #14329 )
2024-10-13 21:34:51 -05:00
Nicolas Mowen
d4b9b5a7dd
Reduce onnx memory usage ( #14285 )
2024-10-11 13:03:47 -05:00
Nicolas Mowen
6df541e1fd
Openvino models ( #14283 )
...
* Enable model conversion cache for openvino
* Use openvino directly for onnx embeddings if available
* Don't fail if zmq is busy
2024-10-11 10:47:23 -06:00
Nicolas Mowen
bc3a06178b
Embedding gpu ( #14253 )
2024-10-09 19:46:31 -06:00
Nicolas Mowen
05fe7f8a48
Fixes & Tweaks ( #14013 )
...
* Rework to create util for onnx initialization
* Fix shm log
* Fix onClick exceptoins
2024-09-27 07:41:48 -06:00
