Blake Blackshear
0ccf543ec1
clarify a few things in logs
2021-08-14 14:04:00 -05:00
Blake Blackshear
1823bd0305
fix scaling
2021-08-09 07:46:28 -05:00
Blake Blackshear
dc759a3e56
use new pycoral libraries
2021-08-07 15:34:55 -05:00
Blake Blackshear
92aa16c556
add labelmap customization to the config ( fixes #507 )
2021-07-07 22:58:18 -05:00
Patrick
7ad8b8298d
identity check is correct way to check for None
2021-06-27 08:09:58 -05:00
Sean Vig
84a0827aee
Use dataclasses for config handling
...
Use config data classes to eliminate some of the boilerplate associated
with setting up the configuration. In particular, using dataclasses
removes a lot of the boilerplate around assigning properties to the
object and allows these to be easily immutable by freezing them. In the
case of simple, non-nested dataclasses, this also provides more
convenient `asdict` helpers.
To set this up, where previously the objects would be parsed from the
config via the `__init__` method, create a `build` classmethod that does
this and calls the dataclass initializer.
Some of the objects are mutated at runtime, in particular some of the
zones are mutated to set the color (this might be able to be refactored
out) and some of the camera functionality can be enabled/disabled. Some
of the configs with `enabled` properties don't seem to have mqtt hooks
to be able to toggle this, in particular, the clips, snapshots, and
detect can be toggled but rtmp and record configs do not, but all of
these configs are still not frozen in case there is some other
functionality I am missing.
There are a couple other minor fixes here, one that was introduced
by me recently where `max_seconds` was not defined, the other to
properly `get()` the message payload when handling publishing mqtt
messages sent via websocket.
2021-05-23 20:38:57 -05:00
Sean Vig
57864f2be6
Wait on stop event when possible
...
Generally eliminate the `while True` loops while waiting for a stop
event and prefer to condition the loops on if the stop event is set,
blocking on that where it makes sense. This generally comes in 3
flavors. First and simplest, when there is a sleep and the stop event
is the only thing the loop blocks on, instead do a check using
`stop_event.wait(timeout)` to instead block on the stop event for the
designated amount of time. Second, when there is a different event that
is blocking in the loop, condition the loop on `stop_event.is_set()`
rather than breaking when it is set. Finally, when there is a separate
internal condition that requires a counter, have the loop iterate over
the counter and use `if stop_event.wait(timeout)` internal to the loop.
2021-05-22 07:54:16 -05:00
Blake Blackshear
39ff49e054
formatting cleanup
2021-02-25 07:01:57 -06:00
Blake Blackshear
e299e73a68
ignore detections that don't overlap with motion
2021-02-20 08:20:17 -06:00
Blake Blackshear
9550ac7422
fix intersection calculation
2021-02-20 08:20:17 -06:00
Blake Blackshear
1cbe6f77ee
only run detection on objects that intersect with motion
2021-02-20 08:20:17 -06:00
Blake Blackshear
ee3e744cc6
tail last 100 lines of ffmpeg logs and dump when failure detected
2021-01-31 06:18:35 -06:00
Blake Blackshear
39040c1874
enable and disable detection via mqtt
2021-01-26 21:40:33 -06:00
Blake Blackshear
b2c7fc8f5b
add mask as object filter
2021-01-26 21:40:33 -06:00
Nat Morris
4619836122
Set titles for forked processes
2021-01-26 21:40:33 -06:00
Blake Blackshear
899d41f361
allow runtime drawing settings for mjpeg and latest
2021-01-26 21:40:33 -06:00
Blake Blackshear
3bc7cdaab6
configurable motion and detect settings
2021-01-26 21:40:33 -06:00
Blake Blackshear
a4b88ac4a7
fix process clip
2021-01-26 21:40:33 -06:00
Blake Blackshear
d0470fffcc
allow defining model shape and switch to mobiledet as default model
2021-01-26 21:40:33 -06:00
Blake Blackshear
d60ca9d783
log level configuration
2021-01-26 21:40:33 -06:00
Blake Blackshear
d62aec7287
graceful exit of subprocesses
2021-01-26 21:40:33 -06:00
Blake Blackshear
4e0cf3681e
add multiple streams per camera
2021-01-26 21:40:33 -06:00
Blake Blackshear
03c855ecbe
sort imports
2021-01-26 21:40:33 -06:00
Blake Blackshear
3a3cb24631
naming threads and processes for logs
2021-01-26 21:40:33 -06:00
Blake Blackshear
4c3fea25a5
use a queue for logging
2021-01-26 21:40:33 -06:00
Blake Blackshear
af303cbf2a
create typed config classes
2021-01-26 21:40:33 -06:00
Blake Blackshear
9778a748fc
add capture processes
2021-01-26 21:40:33 -06:00
Blake Blackshear
a89dddcafa
add camera processors
2021-01-26 21:40:33 -06:00
Blake Blackshear
64b63142b1
start the frame rate tracker
2020-10-26 08:01:18 -05:00
Blake Blackshear
cee1ab000b
make ffmpeg pid available for cache maintenance ( fixes #271 )
2020-10-26 08:01:18 -05:00
Blake Blackshear
eafde6c677
capture ffmpeg in a dedicated process
2020-10-25 14:30:36 -05:00
Blake Blackshear
35ba5e2f7c
improve frame memory management
2020-10-25 14:30:36 -05:00
Blake Blackshear
12c4cd77c5
only convert pix_fmt when necessary
2020-10-18 13:47:13 -05:00
Blake Blackshear
a611cbb942
use yuv420p pixel format for motion
2020-10-18 13:47:13 -05:00
Blake Blackshear
f946813ccb
support multiple coral devices ( fixes #100 )
2020-10-18 13:47:13 -05:00
Blake Blackshear
ec4d048905
upgrade to python3.8 and switch from plasma store to shared_memory
2020-10-18 13:47:13 -05:00
Blake Blackshear
005e188d38
continue if frames not in frame manager
2020-09-17 07:37:27 -05:00
Blake Blackshear
5fe201da25
avoid processing broken frames
2020-09-17 07:37:27 -05:00
Blake Blackshear
1ce993051e
add support for polygon masks
2020-09-17 07:37:27 -05:00
Blake Blackshear
1c33b8acb2
handle mask files that failed to read
2020-09-17 07:37:27 -05:00
Blake Blackshear
5e77436d39
fix coral fps value
2020-09-17 07:37:27 -05:00
Blake Blackshear
c16ee3186f
fix masks
2020-09-17 07:37:27 -05:00
Blake Blackshear
acb75fa02d
refactor and reduce false positives
2020-09-17 07:37:27 -05:00
Blake Blackshear
ea4ecae27c
Refactor with a working false positive test
2020-09-17 07:37:27 -05:00
Blake Blackshear
adcfe699c2
ensure frigate can exit gracefully
2020-08-08 07:40:48 -05:00
Blake Blackshear
e6c6338266
allow mask to be base64 encoded into the config file
2020-08-08 07:40:48 -05:00
Blake Blackshear
c1f522ff54
fix box merging
2020-07-26 12:00:46 -05:00
Blake Blackshear
760e1ffe1d
skip frames in the capture thread instead
2020-06-02 05:25:02 -05:00
Blake Blackshear
15b4024715
expose frame time at each step of processing
2020-06-02 05:25:02 -05:00
Blake Blackshear
4ee200a81c
move ffmpeg capture to a separate thread and use a queue
2020-06-02 05:25:02 -05:00
Blake Blackshear
6de8e3bd1f
remove sharedarray references
2020-06-02 05:25:02 -05:00
Blake Blackshear
3a9781c4f8
handle various scenarios with external process failures
2020-06-02 05:25:02 -05:00
Blake Blackshear
a5bef89123
improve detection processing and restart when stuck
2020-03-03 20:26:53 -06:00
Blake Blackshear
d8aa73d26e
handle ffmpeg process failures in the camera process itself
2020-03-03 20:26:53 -06:00
Blake Blackshear
791409d5e5
add a few print statements for debugging
2020-03-03 20:26:53 -06:00
Blake Blackshear
8e73c7e95e
increase the buffer size a bit
2020-03-03 20:26:53 -06:00
Blake Blackshear
76a7a3bad5
allow specifying the frame size in the config instead of detecting
2020-03-03 20:26:53 -06:00
Blake Blackshear
e6892d66b8
update docs and add back benchmark
2020-03-03 20:26:53 -06:00
Blake Blackshear
3e6f6edf7e
check avg wait before dropping frames
2020-03-03 20:26:53 -06:00
Blake Blackshear
6f6d202c99
improve watchdog and coral fps tracking
2020-03-03 20:26:53 -06:00
Blake Blackshear
05951aa7da
cleanup
2020-03-03 20:26:53 -06:00
Blake Blackshear
bb8e4621f5
add models and convert speed to ms
2020-03-03 20:26:53 -06:00
Blake Blackshear
04e9ab5ce4
add watchdog for camera processes
2020-03-03 20:26:53 -06:00
Blake Blackshear
1089a40943
cleanup old code
2020-03-03 20:26:53 -06:00
Blake Blackshear
68c3a069ba
add a min_fps option
2020-03-03 20:26:53 -06:00
Blake Blackshear
80b9652f7a
check plasma store and consolidate frame drawing
2020-03-03 20:26:53 -06:00
Blake Blackshear
569e07949f
split into separate processes
2020-03-03 20:26:53 -06:00
Blake Blackshear
cd057370e1
fallback to opencv to detect resolution and allow config to specify
2020-02-22 09:03:00 -06:00
Blake Blackshear
6263912655
use ffprobe to get frame shape ( fixes #87 )
2020-02-22 09:03:00 -06:00
Blake Blackshear
af247275cf
make timestamp on snapshots configurable ( fixes #88 )
2020-02-22 09:03:00 -06:00
Blake Blackshear
1198c29dac
make watchdog timeout configurable per camera ( fixes #95 )
2020-02-22 09:03:00 -06:00
Blake Blackshear
38efbd63ea
add camera name to ffmpeg log messages
2020-02-22 09:03:00 -06:00
Blake Blackshear
50bcad8b77
skip regions when the queue is too full and add more locks
2020-02-22 09:03:00 -06:00
Blake Blackshear
cfffb219ae
switch back to stretch for hwaccel issues
2020-02-22 09:03:00 -06:00
Blake Blackshear
382d7be50a
check correct object
2020-02-22 09:03:00 -06:00
Blake Blackshear
38e7fa07d2
add a label position arg for bounding boxes
2020-02-22 09:03:00 -06:00
Blake Blackshear
e261c20819
let the queues get as big as needed
2020-02-22 09:03:00 -06:00
Blake Blackshear
2aada930e3
fix multiple object type tracking
2020-02-22 09:03:00 -06:00
Blake Blackshear
d87f4407a0
switch everything to run off of tracked objects
2020-02-22 09:03:00 -06:00
Blake Blackshear
16f7a361c3
fix object filters
2020-02-22 09:03:00 -06:00
Blake Blackshear
65579e9cbf
add thread to write frames to disk
2020-02-22 09:03:00 -06:00
Blake Blackshear
5199242a68
remove unused current frame variable
2020-02-22 09:03:00 -06:00
Blake Blackshear
cc2abe93a6
track objects and add config for tracked objects
2020-02-22 09:03:00 -06:00
Blake Blackshear
0c6717090c
implement filtering and switch to NMS with OpenCV
2020-02-22 09:03:00 -06:00
Blake Blackshear
f5a2252b29
cleanup imports
2020-02-22 09:03:00 -06:00
Blake Blackshear
02efb6f415
fixing a few things
2020-02-22 09:03:00 -06:00
Blake Blackshear
9cc46a71cb
working dynamic regions, but messy
2020-02-22 09:03:00 -06:00
Blake Blackshear
be1673b00a
process detected objects in a queue
2020-02-22 09:03:00 -06:00
Blake Blackshear
b6130e77ff
label threads and implements stats endpoint
2020-02-22 09:03:00 -06:00
Blake Blackshear
4180c710cd
refactor resizing into generic priority queues
2020-02-22 09:03:00 -06:00
Blake Blackshear
6c87ce0879
cache the computed jpg bytes to reduce cpu usage
2020-01-02 07:39:57 -06:00
Blake Blackshear
480175d70f
add color map to use different colors for different objects
2020-01-02 07:39:57 -06:00
Blake Blackshear
bee99ca6ff
track and report all detected object types
2020-01-02 07:39:57 -06:00
Blake Blackshear
3a3afe14bf
change the ffmpeg config for global defaults and overrides
2019-12-08 16:03:23 -06:00
Blake Blackshear
e818744d81
print the frame time on the image
2019-12-08 08:55:54 -06:00
Blake Blackshear
ceedfae993
add max person area
2019-12-08 07:17:18 -06:00
Blake Blackshear
e13563770d
allow full customization of input
2019-12-08 07:06:52 -06:00
blakeblackshear
ba71927d53
allow setting custom output params and setting the log level for ffmpeg
2019-08-25 08:54:19 -05:00
blakeblackshear
04fed31eac
increase watchdog timeout to 10 seconds
2019-08-25 08:54:19 -05:00
blakeblackshear
ebaa8fac01
tweak input params and gracefully kill ffmpeg
2019-08-25 08:54:19 -05:00
blakeblackshear
2ec45cd1b6
send the best person frame over mqtt for faster updates in homeassistant
2019-08-25 08:54:19 -05:00
blakeblackshear
700bd1e3ef
use a thread to capture frames from the subprocess so it can be killed properly
2019-07-30 19:11:22 -05:00
Alexis Birkill
c9e9f7a735
Fix comparison of object x-coord against mask ( #52 )
2019-07-30 19:11:22 -05:00
blakeblackshear
aea4dc8724
a few fixes
2019-07-30 19:11:22 -05:00
blakeblackshear
436b876b24
add support for ffmpeg hwaccel params and better mask handling
2019-07-30 19:11:22 -05:00
Kyle Niewiada
c653567cc1
Add area labels to bounding boxes ( #47 )
...
* Add object size to the bounding box
Remove script from Dockerfile
Fix framerate command
Move default value for framerate
update dockerfile
dockerfile changes
Add person_area label to surrounding box
Update dockerfile
ffmpeg config bug
Add `person_area` label to `best_person` frame
Resolve debug view showing area label for non-persons
Add object size to the bounding box
Add object size to the bounding box
* Move object area outside of conditional to work with all object types
2019-07-30 19:11:22 -05:00
blakeblackshear
59a4b0e650
add ability to process every nth frame
2019-07-30 19:11:22 -05:00
blakeblackshear
c41b104997
extra ffmpeg params to reduce latency
2019-07-30 19:11:22 -05:00
blakeblackshear
2d22a04391
reduce verbosity of ffmpeg
2019-07-30 19:11:22 -05:00
blakeblackshear
baa587028b
use a regular subprocess for ffmpeg, refactor bounding box drawing
2019-07-30 19:11:22 -05:00
blakeblackshear
2b51dc3e5b
experimental: running ffmpeg directly and capturing raw frames
2019-07-30 19:11:22 -05:00
blakeblackshear
9f8278ea8f
working odroid build, still needs hwaccel
2019-07-30 19:11:22 -05:00
blakeblackshear
3019b0218c
make the threshold configurable per region. fixes #31
2019-05-11 07:39:27 -05:00
blakeblackshear
6900e140d5
add a watchdog to the capture process to detect silent failures. fixes #27
2019-05-11 07:16:15 -05:00
blakeblackshear
dbcfd109f6
fix missing import
2019-05-10 06:19:39 -05:00
blakeblackshear
4dacf02ef9
add the ability to mask the standing location of a person
2019-04-30 20:35:22 -05:00
blakeblackshear
e0b9b616ce
cleanup and update readme
2019-03-30 07:58:31 -05:00
blakeblackshear
edf0cd36df
add back flask endpoints
2019-03-29 21:02:40 -05:00
blakeblackshear
0279121d77
WIP: convert to camera class
2019-03-29 20:49:27 -05:00
blakeblackshear
200d769003
removing motion detection
2019-03-27 06:17:00 -05:00
blakeblackshear
8bae05cfe2
first working version, single region and motion detection disabled
2019-03-17 09:03:52 -05:00
blakeblackshear
df7b90e367
store the best recent person image and reconnect the RTSP stream if unable to grab several consecutive frames
2019-02-27 20:55:07 -06:00
blakeblackshear
2e3c9da650
manage 2 seconds worth of motion frames for processing
2019-02-26 20:29:52 -06:00
blakeblackshear
86f5d8128d
initial refactoring
2019-02-25 20:27:02 -06:00
