Please help with detection and MQTT

[pinkfloydFR]

Hi all !

After a LOT of test i cannot figure how to solve this. I have Home assistant + node red and a frigate docker.

My goal is to receive a notification when someone enter in a zone 0, but i receive a notification too when someone is detected anywhere in the camera.

EDIT : in frigate event i see recording with people NOT in my zone_0, i feel stupid to not understand the problem

Do i need a motion mask with same coordonate of my zone_0 ?

As french, i think i don't understand well the difference between zone, mask and regions.

Will be gratefull is someone can help me for this ! Thanks !

# -------------
  entree:
    ffmpeg:
      inputs:
        - path: rtsp://pinkfloyd:ToDf219555!@192.168.0.97:554/stream1
          roles:
            - detect
            - rtmp
            - record
    motion:
      mask: 0,129,0,0,1920,0,1920,946,1920,618,1592,280,0,290
    detect:
      width: 1920
      height: 1080
      fps: 10
    record:
      enabled: True
      events:
        required_zones:
          - zone_0
    snapshots:
      required_zones:
        - zone_0
    zones:
      zone_0:
        coordinates: 0,129,0,0,1920,0,1920,946,1920,618,1592,280,0,290
        objects:
          - person

And the MQTT topic i read : "frigate/entree/person"

[NickM-27]

The MQTT messages include values before["current_zones"] and after["current_zones"]. You will want to make sure that zone_0 is included in one of those to send the notification.

https://docs.frigate.video/integrations/mqtt#frigateevents

[pinkfloydFR]

thanks, will try to filter the message to see if it resolve my problem, thk !

[pinkfloydFR]

Im going crazy, why the hell frigate is searching people outside my zone ?

[NickM-27]

I'm not sure what exactly you're trying to show. Seems that it sees 3 people inside of your zone (likely false positives by the looks of the screenshot)

[NickM-27]

You should turn on bounding boxes so it is clear what "person" it sees

[pinkfloydFR]

What iam trying to show, is the view of frigate with no one but the mqtt message as 4 in this exemple :

while frigate mqtt : "frigate/entree/person/snapshot" send me a snapshot of people in the upper screen ( black in my capture )

[NickM-27]

Do you have Bounding Box enabled in the debug configuration for that camera? Just because there is not a person does not mean that frigate doesn't "see" anyone. For example, that scooter could be seen as a person by frigate (false positive). This information is needed to understand why it thinks that.

[pinkfloydFR]

bounding box is on yes

[NickM-27]

while frigate mqtt : "frigate/entree/person/snapshot" send me a snapshot of people in the upper screen ( black in my capture )

this is expected, mqtt is not restricted to only sending messages when a zone is entered.

Just to make a note, your setup with that large motion mask is not recommended and advised against in the docs. What I think is happening here is people are walking through the zone and then "getting stuck" because their motion is being blocked out. Basically frigate runs detection where motion is seen, so with your setup all motion outside the zone is being blocked and the object gets stuck

[NickM-27]

See https://docs.frigate.video/configuration/masks

Motion masks: Motion masks are used to prevent unwanted types of motion from triggering detection. Try watching the debug feed with Motion Boxes enabled to see what may be regularly detected as motion. For example, you want to mask out your timestamp, the sky, rooftops, etc. Keep in mind that this mask only prevents motion from being detected and does not prevent objects from being detected if object detection was started due to motion in unmasked areas. Motion is also used during object tracking to refine the object detection area in the next frame. Over masking will make it more difficult for objects to be tracked. To see this effect, create a mask, and then watch the video feed with Motion Boxes enabled again.

[pinkfloydFR]

Frigate continue to publish mqtt image outside the zone, this is my problem

Despite sending me a MQTT message ONLY when a person enter in my zone_0 ( bottom screen so )

[NickM-27]

That is by design, you need to use the data included in the mqtt payload to handle this

[pinkfloydFR]

Can you show me the way please ? Oh sorry, i think i got it, will give it a try

[NickM-27]

I don't know NodeRED, but there is an entire payload included in the mqtt message that has all the data https://docs.frigate.video/integrations/mqtt#frigateevents

You can see it in the screenshot of the MQTT explorer.

[pinkfloydFR]

I think i got it, i listern "frigate/event" and filter with 👍

[NickM-27]

May want to make some adjustments in the event you have multiple zones (I think that would fail if it was entered_zones: ["zone_1", "zone_2"]

Overall looks good though 👍

[pinkfloydFR]

Totally agreed, this is a poc/test for now :)