Skip to content

DT-588-new-processors#402

Merged
KorayErkan merged 6 commits intodevfrom
DT-588-new-processors
Feb 27, 2026
Merged

DT-588-new-processors#402
KorayErkan merged 6 commits intodevfrom
DT-588-new-processors

Conversation

@KorayErkan
Copy link
Collaborator

@KorayErkan KorayErkan commented Feb 24, 2026

  • Introduced the break processor to halt execution of remaining processors in the pipeline, with detailed configuration options and examples.
  • Added the network_split processor to separate host and port from a combined address string, including various usage scenarios and configuration details.
  • Updated topics.json to include new processor entries for break and network_split.

Summary by CodeRabbit

Release Notes

  • New Features

    • Added 5 new processors: Break (halts pipeline flow), Matches (pattern matching), Network Split (IP/port extraction), Suppress (event deduplication), and TSV (tab-separated value parsing).
  • Documentation

    • Expanded processor library documentation with detailed configuration schemas and usage examples.
    • Enhanced Contains processor with case sensitivity and partial matching capabilities.
    • Updated processor support to 174+.

- Introduced the `break` processor to halt execution of remaining processors in the pipeline, with detailed configuration options and examples.
- Added the `network_split` processor to separate host and port from a combined address string, including various usage scenarios and configuration details.
- Updated topics.json to include new processor entries for `break` and `network_split`.
@coderabbitai
Copy link

coderabbitai bot commented Feb 24, 2026

📝 Walkthrough

Walkthrough

This PR adds documentation for five new processors (Break, Matches, Network Split, Suppress, and TSV), enhances the Contains processor documentation with new configuration fields, and updates processor count references from 169+ to 174+ across multiple files. Navigation and topic mapping entries are added to reflect the new documentation.

Changes

Cohort / File(s) Summary
New Processor Documentation
docs/configuration/pipelines/processors/break.mdx, docs/configuration/pipelines/processors/matches.mdx, docs/configuration/pipelines/processors/network-split.mdx, docs/configuration/pipelines/processors/suppress.mdx, docs/configuration/pipelines/processors/tsv.mdx
Five new processor documentation files covering Break (halts pipeline processing), Matches (pattern/regex matching), Network Split (IPv4/IPv6 address parsing), Suppress (deduplication via sliding window), and TSV (tab-separated value parsing). Each includes schema, configuration details, and usage examples.
Updated Processor Documentation
docs/configuration/pipelines/processors/contains.mdx
Expanded schema with new fields (case_sensitive, disabled, partial); revised field descriptions and defaults; rewritten Details section clarifying exact matching, case sensitivity, partial substring matching, and template support; added new Partial Match, Case Sensitive, and Templates examples.
Navigation & Metadata Updates
sidebars.ts, topics.json
Added sidebar entries and topic mappings for the five new processors to integrate them into documentation navigation.
Count References
docs/about/key-features.mdx, static/img/graphics/feature-processor-support.mmd
Updated processor count labels from 169+ to 174+ in feature overview documentation and diagram.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

Poem

Five new processors join the fray,
Breaking pipelines in just the right way,
Matching patterns with pride and grace,
While docs guide you through every case,
From tabs to networks—design complete! ✨

🚥 Pre-merge checks | ✅ 3
✅ Passed checks (3 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title 'DT-588-new-processors' is a ticket reference that accurately describes the main change—adding five new processor documentation files and updating related configuration.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.


Comment @coderabbitai help to get the list of available commands and usage tips.

@cloudflare-workers-and-pages
Copy link

cloudflare-workers-and-pages bot commented Feb 24, 2026

Deploying virtualmetric-docs-test with  Cloudflare Pages  Cloudflare Pages

Latest commit: 700a920
Status: ✅  Deploy successful!
Preview URL: https://8fa245a7.virtualmetric-docs-test.pages.dev
Branch Preview URL: https://dt-588-new-processors.virtualmetric-docs-test.pages.dev

View logs

@github-actions
Copy link

@yusufozturk
Copy link
Member

@coderabbitai full review

@coderabbitai
Copy link

coderabbitai bot commented Feb 27, 2026

✅ Actions performed

Full review triggered.

Copy link

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🧹 Nitpick comments (2)
docs/configuration/pipelines/processors/tsv.mdx (1)

53-53: Clarify the CSV fallback sentence for readability.

Line 53 is a bit redundant and can be simplified to make the fallback guidance easier to scan.

✍️ Suggested wording
-The processor reads a single line of TSV data and maps each tab-delimited column to the corresponding target field. The tab separator is hardcoded and cannot be configured — use the `csv` processor with `separator: "\t"` equivalent or the `csv` processor's `separator` field for other delimiters.
+The processor reads a single line of TSV data and maps each tab-delimited column to the corresponding target field. The tab separator is fixed and cannot be configured. For equivalent behavior, use the `csv` processor with `separator: "\t"`; for other delimiters, configure the `csv` processor accordingly.

As per coding guidelines, Ensure consistency in terminology and formatting across all documentation files.

🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.

In `@docs/configuration/pipelines/processors/tsv.mdx` at line 53, Simplify the
redundant fallback sentence: replace the current line explaining the hardcoded
tab separator with a single, clear sentence such as "Use the csv processor with
separator: \"\\t\" to parse TSV data, or set the csv processor's separator field
to parse other delimiters." Ensure terminology matches existing docs (use "csv
processor" and "separator") and maintain the same formatting style as
surrounding documentation.
docs/configuration/pipelines/processors/contains.mdx (1)

166-187: Consider standardizing outcome wording in the example.

“returns no match” is slightly less explicit than other outcome phrasing (e.g., “returns success”); using a canonical result term (such as “returns failure”) would improve consistency.

As per coding guidelines “Ensure consistency in terminology and formatting across all documentation files.”

🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.

In `@docs/configuration/pipelines/processors/contains.mdx` around lines 166 - 187,
In the "Case Sensitive" ExampleGrid replace the outcome wording in the final
CommentCol from "returns no match" to the canonical term used elsewhere (e.g.,
"returns failure") so terminology is consistent; update the CommentCol text that
explains the result of the case_sensitive example to read "returns failure
because \"WARNING\" does not equal \"warning\" in case-sensitive mode" (or
similar canonical phrasing) within the same ExampleGrid block.
🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.

Nitpick comments:
In `@docs/configuration/pipelines/processors/contains.mdx`:
- Around line 166-187: In the "Case Sensitive" ExampleGrid replace the outcome
wording in the final CommentCol from "returns no match" to the canonical term
used elsewhere (e.g., "returns failure") so terminology is consistent; update
the CommentCol text that explains the result of the case_sensitive example to
read "returns failure because \"WARNING\" does not equal \"warning\" in
case-sensitive mode" (or similar canonical phrasing) within the same ExampleGrid
block.

In `@docs/configuration/pipelines/processors/tsv.mdx`:
- Line 53: Simplify the redundant fallback sentence: replace the current line
explaining the hardcoded tab separator with a single, clear sentence such as
"Use the csv processor with separator: \"\\t\" to parse TSV data, or set the csv
processor's separator field to parse other delimiters." Ensure terminology
matches existing docs (use "csv processor" and "separator") and maintain the
same formatting style as surrounding documentation.

ℹ️ Review info

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Disabled knowledge base sources:

  • Jira integration is disabled

You can enable these sources in your CodeRabbit configuration.

📥 Commits

Reviewing files that changed from the base of the PR and between 96d34fd and 700a920.

⛔ Files ignored due to path filters (1)
  • static/img/graphics/feature-processor-support.svg is excluded by !**/*.svg
📒 Files selected for processing (10)
  • docs/about/key-features.mdx
  • docs/configuration/pipelines/processors/break.mdx
  • docs/configuration/pipelines/processors/contains.mdx
  • docs/configuration/pipelines/processors/matches.mdx
  • docs/configuration/pipelines/processors/network-split.mdx
  • docs/configuration/pipelines/processors/suppress.mdx
  • docs/configuration/pipelines/processors/tsv.mdx
  • sidebars.ts
  • static/img/graphics/feature-processor-support.mmd
  • topics.json

@KorayErkan KorayErkan merged commit c02b7bd into dev Feb 27, 2026
3 checks passed
@KorayErkan KorayErkan deleted the DT-588-new-processors branch February 27, 2026 14:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants