[New Rule] Azure Arc Kubernetes Cluster Connect Abuse

[terrancedejesus]

Fixes #5823

Pull Request

Issue link(s):

• [New Rule] Azure Arc Kubernetes Cluster Connect Abuse #5823

Summary - What I changed

Adds 4 new rules across Azure and K8s integrations to cover Azure Arc-assisted suspicious anomalies. Please see the issue for more details.

How To Test

Checklist

• Added a label for the type of pr: bug, enhancement, schema, maintenance, Rule: New, Rule: Deprecation, Rule: Tuning, Hunt: New, or Hunt: Tuning so guidelines can be generated
• Added the meta:rapid-merge label if planning to merge within 24 hours
• Secret and sensitive material has been managed correctly
• Automated testing was updated or added to match the most common scenarios
• Documentation and comments were added for features that require explanation

Contributor checklist

• Have you signed the contributor license agreement?
• Have you followed the contributor guidelines?

[github-actions]

Rule: New - Guidelines

These guidelines serve as a reminder set of considerations when proposing a new rule.

Documentation and Context

• Detailed description of the rule.
• List any new fields required in ECS/data sources.
• Link related issues or PRs.
• Include references.

Rule Metadata Checks

• creation_date matches the date of creation PR initially merged.
• min_stack_version should support the widest stack versions.
• name and description should be descriptive and not include typos.
• query should be inclusive, not overly exclusive, considering performance for diverse environments. Non ecs fields should be added to non-ecs-schema.json if not available in an integration.
• min_stack_comments and min_stack_version should be included if the rule is only compatible starting from a specific stack version.
• index pattern should be neither too specific nor too vague, ensuring it accurately matches the relevant data stream (e.g., use logs-endpoint.process-* for process data).
• integration should align with the index. If the integration is newly introduced, ensure the manifest, schemas, and new_rule.yaml template are updated.
• setup should include the necessary steps to configure the integration.
• note should include any additional information (e.g. Triage and analysis investigation guides, timeline templates).
• tags should be relevant to the threat and align/added to the EXPECTED_RULE_TAGS in the definitions.py file.
• threat, techniques, and subtechniques should map to ATT&CK always if possible.

New BBR Rules

• building_block_type should be included if the rule is a building block and the rule should be located in the rules_building_block folder.
• bypass_bbr_timing should be included if adding custom lookback timing to the rule.

Testing and Validation

• Provide evidence of testing and detecting the expected threat.
• Check for existence of coverage to prevent duplication.

[Mikaayenson]

Maybe we should update definitions.py to include these as expected tags?

[Mikaayenson]

Is this needed when we have

from = "now-5d"
interval = "9m"

Can we let the detection engine handle this?

[terrancedejesus]

Yes, this is how to apply the New Terms logic.

• Grab the last 5 days work of data for this given query
• Store the first seen time stamp if we have hits
• The first time seen has to be greater than or equal to the last 9 minutes (meaning it has never been seen before until this run)

[terrancedejesus]

Can we let the detection engine handle this?

@Samirbous has suggested that ESQL new terms logic is more performant than new terms rule type in recent discussions so I assume so. Additionally these rules all do 5 day lookback windows as well, just in minutes.