impr(workflow engine): Add caching for detector lookup by data source

[Christinarlong]

Okay basically we're caching the bulk query and adapting the single detector query in the subscription processor work with that.

^{Cursor Bugbot reviewed your changes and found no issues for commit e31fc92}

[saponifi3d]

let me know if it'd help to hop on a call / discuss any of these comments too! this whole area is pretty confusing, even for those with context. haha

[saponifi3d]

up to you on flattening the cache stuff and pulling it off of the detector model, i would recommend it as it will allow us to DRY up the code around purging / updating the cache.

[cursor]

Cursor Bugbot has reviewed your changes and found 1 potential issue.

^{Bugbot Autofix is OFF. To automatically fix reported issues with Cloud Agents, enable Autofix in the Cursor dashboard.}

[cursor]

Cursor Bugbot has reviewed your changes and found 2 potential issues.

^{Bugbot Autofix is OFF. To automatically fix reported issues with Cloud Agents, enable Autofix in the Cursor dashboard.}

[saponifi3d]

🎉 this is looking great, mostly detailed comments on the implementation.

[saponifi3d]

can you also add a rollout flag here so we can easily enable / disable caching incase there are any unexpected issues or invalidations we haven't accounted for?

[Christinarlong]

This one is a little weird since I'm not sure if the tradeoff is worth it. This callsite has some indirection where in order to reference an organization we need to look up the DataSource -> Organization. That's a db query every time though so although it's here idk if it's worth it.

[cursor]

Cursor Bugbot has reviewed your changes and found 3 potential issues.

^{Bugbot Autofix is OFF. To automatically fix reported issues with Cloud Agents, enable Autofix in the Cursor dashboard.}