azureeventhub: remove deprecated processor v1 implementation

[zmoog]

Summary

• Remove the deprecated Azure Event Hub processor v1 implementation and all related code (v1 input, tracer, file persister tests, integration tests)
• When processor_version: "v1" is configured, log a deprecation warning and fall back to v2 instead of erroring
• Update documentation, dependency cleanup (go.mod, NOTICE.txt, dependabot.yml)

TODO

• Clean up config validation: remove empty validation stubs, drop "V2" suffixes and "(processor v2 only)" comments
• Update misleading "available versions: v1, v2" error message

Test plan

• Verify processor_version: "v2" (default) works unchanged
• Verify processor_version: "v1" logs deprecation warning and falls back to v2
• Verify invalid processor_version values are rejected
• Run existing integration tests

🤖 Generated with Claude Code

[botelastic]

This pull request doesn't have a Team:<team> label.

[github-actions]

🤖 GitHub comments

Just comment with:

• run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

[mergify]

This pull request does not have a backport label.
If this is a bug or security fix, could you label this PR @zmoog? 🙏.
For such, you'll need to label your PR with:

• The upcoming major version of the Elastic Stack
• The upcoming minor version of the Elastic Stack (if you're not pushing a breaking change)

To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

• backport-8./d is the label to automatically backport to the 8./d branch. /d is the digit
• backport-active-all is the label that automatically backports to all active branches.
• backport-active-8 is the label that automatically backports to all active minor branches for the 8 major.
• backport-active-9 is the label that automatically backports to all active minor branches for the 9 major.

[github-actions]

TL;DR

Buildkite failed in x-pack/filebeat: Run check/update because repo state becomes dirty during make -C x-pack/filebeat check update: x-pack/filebeat/input/azureeventhub/input_test.go is being rewritten by the update/check pipeline.

Remediation

• On the PR branch, run make -C x-pack/filebeat update (or mage -d x-pack/filebeat update) and commit the resulting change to x-pack/filebeat/input/azureeventhub/input_test.go.
• Re-run make -C x-pack/filebeat check update locally to confirm check-no-changes passes before re-triggering CI.

Investigation details

Root Cause

check-no-changes detected generated/normalized file drift after the update step. The failing step explicitly reports a modified file:

• x-pack/filebeat/input/azureeventhub/input_test.go

This is a configuration/generated-artifact drift failure (not an infra outage): CI is enforcing that update-generated edits are committed.

Evidence

• Build: https://buildkite.com/elastic/beats/builds/43258
• Job/step: x-pack/filebeat: Run check/update (beats-xpack-filebeat [8.0](backport #29167) libbeat,packetbeat,x-pack/filebeat/input/netflow: unify gopacket dependencies #29283)
• Key log excerpt:
  • Error: some files are not up-to-date. Run 'make update' then review and commit the changes. Modified: [x-pack/filebeat/input/azureeventhub/input_test.go]
  • make: *** [../../dev-tools/make/mage.mk:21: check] Error 1

Verification

• Reproduced the same target locally (make -C x-pack/filebeat check update) and confirmed the failure mode is in the same check/update gate.
• Ran make -C x-pack/filebeat update locally to validate the prescribed remediation path.

Follow-up

If the file still flips after commit, pin and compare local/CI Go+mage versions used for update, then regenerate with the same toolchain as CI.

Note

🔒 Integrity filtering filtered 2 items

Integrity filtering activated and filtered the following items during workflow execution.
This happens when a tool call accesses a resource that does not meet the required integrity or secrecy level of the workflow.

• pr:azureeventhub: remove deprecated processor v1 implementation #49772 (pull_request_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".)
• #49772 (search_issues: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".)

---

What is this? | From workflow: PR Buildkite Detective

Give us feedback! React with 🚀 if perfect, 👍 if helpful, 👎 if not.

[coderabbitai]

📝 Walkthrough

Walkthrough

This pull request removes the Azure Event Hub Processor v1 implementation and consolidates on v2. Changes include: deletion of v1-specific code files (v1_input.go, tracer.go, related tests), removal of associated Go module dependencies from go.mod, and updates to input registration and configuration validation. Configuration fields storage_account_key and resource_manager_endpoint are deprecated in favor of storage_account_connection_string and authority_host. Documentation and tests are updated to reflect v2 as the supported processor version. Backward compatibility is maintained: v1 configurations are accepted and automatically upgraded to v2 with a deprecation warning.

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

• 🛠️ Update Documentation: Commit on current branch
• 🛠️ Update Documentation: Create PR

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[coderabbitai]

Caution

Some comments are outside the diff and can’t be posted inline due to platform limitations.

⚠️ Outside diff range comments (1)

x-pack/filebeat/input/azureeventhub/config.go (1)

387-423: ⚠️ Potential issue | 🟠 Major

Preserve sovereign-cloud behavior for resource_manager_endpoint during v1 fallback.

Line 406 now derives the auto-generated storage connection string only from authority_host. That means an existing v1 config that only sets deprecated resource_manager_endpoint for Gov/China/Germany will validate, be upgraded to v2, and then get a public-cloud storage endpoint (core.windows.net). The downstream effect is broken checkpoint/container access after startup, which defeats the PR’s backward-compat path for those configs. Please either translate resource_manager_endpoint into the matching storage suffix here or reject that deprecated combination instead of silently accepting it.

🤖 Prompt for AI Agents

Verify each finding against the current code and only fix it if needed.

In `@x-pack/filebeat/input/azureeventhub/config.go` around lines 387 - 423, The
auto-generation in validateStorageAccountConfig currently always calls
getStorageEndpointSuffix(conf.AuthorityHost) which causes v1 configs that only
set the deprecated resource_manager_endpoint/OverrideEnvironment to get a
public-cloud suffix; update validateStorageAccountConfig to detect the
deprecated resource_manager_endpoint/OverrideEnvironment when conf.AuthorityHost
is empty and either (a) translate that resource_manager_endpoint value into the
corresponding storage endpoint suffix (and pass that into
getStorageEndpointSuffix or a new translator) before building
conf.SAConnectionString, or (b) if translation is not possible, reject the
combination by returning an error that instructs the user to provide
storage_account_connection_string or an explicit authority_host; reference
validateStorageAccountConfig, getStorageEndpointSuffix, conf.AuthorityHost and
the deprecated resource_manager_endpoint/OverrideEnvironment in the change.

🤖 Prompt for all review comments with AI agents

Verify each finding against the current code and only fix it if needed.

Outside diff comments:
In `@x-pack/filebeat/input/azureeventhub/config.go`:
- Around line 387-423: The auto-generation in validateStorageAccountConfig
currently always calls getStorageEndpointSuffix(conf.AuthorityHost) which causes
v1 configs that only set the deprecated
resource_manager_endpoint/OverrideEnvironment to get a public-cloud suffix;
update validateStorageAccountConfig to detect the deprecated
resource_manager_endpoint/OverrideEnvironment when conf.AuthorityHost is empty
and either (a) translate that resource_manager_endpoint value into the
corresponding storage endpoint suffix (and pass that into
getStorageEndpointSuffix or a new translator) before building
conf.SAConnectionString, or (b) if translation is not possible, reject the
combination by returning an error that instructs the user to provide
storage_account_connection_string or an explicit authority_host; reference
validateStorageAccountConfig, getStorageEndpointSuffix, conf.AuthorityHost and
the deprecated resource_manager_endpoint/OverrideEnvironment in the change.

---

ℹ️ Review info

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 12792d50-af3e-41ea-83d0-176d69aa1db0

📥 Commits

Reviewing files that changed from the base of the PR and between 2d10f57 and a8c66cc.

⛔ Files ignored due to path filters (1)

• go.sum is excluded by !**/*.sum

📒 Files selected for processing (19)

• .github/dependabot.yml
• .gitignore
• NOTICE.txt
• changelog/fragments/1774907084-remove-azureeventhub-processor-v1.yaml
• docs/reference/filebeat/filebeat-input-azure-eventhub.md
• go.mod
• x-pack/filebeat/include/list.go
• x-pack/filebeat/input/azureeventhub/README.md
• x-pack/filebeat/input/azureeventhub/azureeventhub_integration_test.go
• x-pack/filebeat/input/azureeventhub/client_secret.go
• x-pack/filebeat/input/azureeventhub/config.go
• x-pack/filebeat/input/azureeventhub/config_test.go
• x-pack/filebeat/input/azureeventhub/file_persister_test.go
• x-pack/filebeat/input/azureeventhub/input.go
• x-pack/filebeat/input/azureeventhub/input_test.go
• x-pack/filebeat/input/azureeventhub/metrics_test.go
• x-pack/filebeat/input/azureeventhub/tracer.go
• x-pack/filebeat/input/azureeventhub/v1_input.go
• x-pack/filebeat/input/azureeventhub/v1_input_test.go

💤 Files with no reviewable changes (9)

• x-pack/filebeat/include/list.go
• .github/dependabot.yml
• x-pack/filebeat/input/azureeventhub/tracer.go
• x-pack/filebeat/input/azureeventhub/v1_input.go
• x-pack/filebeat/input/azureeventhub/input_test.go
• x-pack/filebeat/input/azureeventhub/azureeventhub_integration_test.go
• go.mod
• x-pack/filebeat/input/azureeventhub/v1_input_test.go
• x-pack/filebeat/input/azureeventhub/file_persister_test.go