Skip to content

Commit 093289f

Browse files
committed
[DOCS-13093] Update scaling best practices with worker deployment and latency info
1 parent e7a6c78 commit 093289f

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

content/en/observability_pipelines/scaling_and_performance/best_practices_for_scaling_observability_pipelines.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -81,8 +81,9 @@ Datadog recommends the decentralized approach of deploying the Workers as close
8181
- Minimizes cross-region or cross-datacenter network transit
8282
- Avoids potential performance issues related to inter-region or inter-account data transfer
8383
- Helps reduce data transfer costs by keeping processing local to the data sources
84+
- Reduces log delivery latency by processing data at the source before forwarding
8485

85-
A centralized deployment runs Workers in a single location, aggregating data from multiple regions, clusters, or datacenters. This approach works best for lower data volumes or when network peering already exists. Be aware that high-volume data transfers across regions or accounts may incur additional costs.
86+
A centralized deployment runs Workers in a single location, aggregating data from multiple regions, clusters, or datacenters. A single pool of Workers can receive data from multiple Kubernetes clusters or AWS accounts. This approach works best for lower data volumes or when network peering already exists between those environments. Be aware that high-volume data transfers across regions or accounts may incur additional costs.
8687

8788
A hybrid model is a good compromise between the decentralized and centralized approaches, particularly for large wide-spread infrastructure deployments. For example, if you have six regions and in each region you have 10 Kubernetes clusters, rather than:
8889

0 commit comments

Comments
 (0)