Skip to content

Enable opt-in for high frequency GPU metrics #1893

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Enable opt-in for high frequency GPU metrics #1893

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 5 additions & 2 deletions go.mod
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,8 @@ replace collectd.org v0.4.0 => github.com/collectd/go-collectd v0.4.0
// to be all replaced since there are some changes that will always be from upstream
replace (
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/awscloudwatchlogsexporter => github.com/amazon-contributing/opentelemetry-collector-contrib/exporter/awscloudwatchlogsexporter v0.0.0-20251014190537-ae1729ad22c4
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/awsemfexporter => github.com/amazon-contributing/opentelemetry-collector-contrib/exporter/awsemfexporter v0.0.0-20251014190537-ae1729ad22c4
//TODO replace with offical repo after dependent PR merged
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/awsemfexporter => github.com/yanhaoluo666/opentelemetry-collector-contrib/exporter/awsemfexporter v0.0.0-20251020112017-94065798a087
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/awsxrayexporter => github.com/amazon-contributing/opentelemetry-collector-contrib/exporter/awsxrayexporter v0.0.0-20251014190537-ae1729ad22c4
)

Expand Down Expand Up @@ -47,7 +48,8 @@ replace (
)

replace (
github.com/open-telemetry/opentelemetry-collector-contrib/receiver/awscontainerinsightreceiver => github.com/amazon-contributing/opentelemetry-collector-contrib/receiver/awscontainerinsightreceiver v0.0.0-20251014190537-ae1729ad22c4
//TODO replace with offical repo after dependent PR merged
github.com/open-telemetry/opentelemetry-collector-contrib/receiver/awscontainerinsightreceiver => github.com/yanhaoluo666/opentelemetry-collector-contrib/receiver/awscontainerinsightreceiver v0.0.0-20251013162607-385c069b9f1f
github.com/open-telemetry/opentelemetry-collector-contrib/receiver/awscontainerinsightskueuereceiver => github.com/amazon-contributing/opentelemetry-collector-contrib/receiver/awscontainerinsightskueuereceiver v0.0.0-20251014190537-ae1729ad22c4
github.com/open-telemetry/opentelemetry-collector-contrib/receiver/awsxrayreceiver => github.com/amazon-contributing/opentelemetry-collector-contrib/receiver/awsxrayreceiver v0.0.0-20251014190537-ae1729ad22c4
github.com/open-telemetry/opentelemetry-collector-contrib/receiver/jmxreceiver => github.com/amazon-contributing/opentelemetry-collector-contrib/receiver/jmxreceiver v0.0.0-20251014190537-ae1729ad22c4
Expand Down Expand Up @@ -145,6 +147,7 @@ require (
github.com/open-telemetry/opentelemetry-collector-contrib/processor/deltatocumulativeprocessor v0.124.0
github.com/open-telemetry/opentelemetry-collector-contrib/processor/deltatorateprocessor v0.124.1
github.com/open-telemetry/opentelemetry-collector-contrib/processor/filterprocessor v0.124.1
github.com/open-telemetry/opentelemetry-collector-contrib/processor/groupbyattrsprocessor v0.124.1
github.com/open-telemetry/opentelemetry-collector-contrib/processor/groupbytraceprocessor v0.124.1
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor v0.124.1
github.com/open-telemetry/opentelemetry-collector-contrib/processor/metricsgenerationprocessor v0.124.1
Expand Down
10 changes: 6 additions & 4 deletions go.sum
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -187,8 +187,6 @@ github.com/aliyun/alibaba-cloud-sdk-go v1.61.1483 h1:J8HaD+Zpfi1gcel3HCKpoHHEsrc
github.com/aliyun/alibaba-cloud-sdk-go v1.61.1483/go.mod h1:RcDobYh8k5VP6TNybz9m++gL3ijVI5wueVr0EM10VsU=
github.com/amazon-contributing/opentelemetry-collector-contrib/exporter/awscloudwatchlogsexporter v0.0.0-20251014190537-ae1729ad22c4 h1:0gvkXM8HrRo9fu+34OYLVngN87FtstrYjhIjAcOyfTA=
github.com/amazon-contributing/opentelemetry-collector-contrib/exporter/awscloudwatchlogsexporter v0.0.0-20251014190537-ae1729ad22c4/go.mod h1:8dL1mhunGsDXn59xUlnNn1ydT5wp6Fh5KTvlBEaN2Po=
github.com/amazon-contributing/opentelemetry-collector-contrib/exporter/awsemfexporter v0.0.0-20251014190537-ae1729ad22c4 h1:XLDJlsz7glQ0PcWYZ9S664H2Hyy/xaRHIT5gGlQFtEk=
github.com/amazon-contributing/opentelemetry-collector-contrib/exporter/awsemfexporter v0.0.0-20251014190537-ae1729ad22c4/go.mod h1:dSu6d3FZqrAECatXDhvYsQIEAaL1iF+fokrPwCjxhC8=
github.com/amazon-contributing/opentelemetry-collector-contrib/exporter/awsxrayexporter v0.0.0-20251014190537-ae1729ad22c4 h1:jn9YrkY2ZLbpT4n6q/EkfSwGH0cx/diKBmlQcYvLTJ8=
github.com/amazon-contributing/opentelemetry-collector-contrib/exporter/awsxrayexporter v0.0.0-20251014190537-ae1729ad22c4/go.mod h1:b9TxHHL62ladWlbU6klYIvDjCN3Ee31oWrKlF50fQns=
github.com/amazon-contributing/opentelemetry-collector-contrib/extension/awsmiddleware v0.0.0-20251014190537-ae1729ad22c4 h1:YQkkr7FxnF52KvG4CIM8a0A/7m6CIQMmtFHqfd8D/PA=
Expand Down Expand Up @@ -229,8 +227,6 @@ github.com/amazon-contributing/opentelemetry-collector-contrib/processor/cumulat
github.com/amazon-contributing/opentelemetry-collector-contrib/processor/cumulativetodeltaprocessor v0.0.0-20251014190537-ae1729ad22c4/go.mod h1:Wvs2QPuB4ngUiOjrJpYWLqfU8X0Z27s33uMKP4YHQmE=
github.com/amazon-contributing/opentelemetry-collector-contrib/processor/resourcedetectionprocessor v0.0.0-20251014190537-ae1729ad22c4 h1:AbFzE4JNvrwGoyDCgmg3WiTaA1bxPc6xzJCwgHEtzNw=
github.com/amazon-contributing/opentelemetry-collector-contrib/processor/resourcedetectionprocessor v0.0.0-20251014190537-ae1729ad22c4/go.mod h1:idk0SX/ZWccyRfPyAKPu1uVvd+KBMT0pE75HHFogitY=
github.com/amazon-contributing/opentelemetry-collector-contrib/receiver/awscontainerinsightreceiver v0.0.0-20251014190537-ae1729ad22c4 h1:kMAB6h54Q/OJDQEP+XCxjcGnyOHq/KuyGiUliGsUFJI=
github.com/amazon-contributing/opentelemetry-collector-contrib/receiver/awscontainerinsightreceiver v0.0.0-20251014190537-ae1729ad22c4/go.mod h1:2/Yuy1ePzxKLoHdJIS/BBdWfMD+wpkudvxe1HXZuMAM=
github.com/amazon-contributing/opentelemetry-collector-contrib/receiver/awscontainerinsightskueuereceiver v0.0.0-20251014190537-ae1729ad22c4 h1:2YfnGwsnhAqUNrOsye+w2xI9rya3KT7RucYFwDDAs30=
github.com/amazon-contributing/opentelemetry-collector-contrib/receiver/awscontainerinsightskueuereceiver v0.0.0-20251014190537-ae1729ad22c4/go.mod h1:431fc3JgruV7R3yhAzu7w0fdPaBp1Tbn4RV+8R4Dtdw=
github.com/amazon-contributing/opentelemetry-collector-contrib/receiver/awsxrayreceiver v0.0.0-20251014190537-ae1729ad22c4 h1:81WCB7g7vOUGs5HSNpuHrzMCXXH+XyOJHju/NkygKms=
Expand Down Expand Up @@ -1278,6 +1274,8 @@ github.com/open-telemetry/opentelemetry-collector-contrib/processor/deltatoratep
github.com/open-telemetry/opentelemetry-collector-contrib/processor/deltatorateprocessor v0.124.1/go.mod h1:bp3Y5GT4dkGWRGEZqKgfanyk6ZSsVGNY5aNDvX4c8WE=
github.com/open-telemetry/opentelemetry-collector-contrib/processor/filterprocessor v0.124.1 h1:qkqiqLwfg7hj+oDYvpmMD64p+poaxXwo654ZE44uPm4=
github.com/open-telemetry/opentelemetry-collector-contrib/processor/filterprocessor v0.124.1/go.mod h1:B/GP3l4Y1qNsNtWVIzpwS8jWB1Nn/vx0sFBlVDkWt9E=
github.com/open-telemetry/opentelemetry-collector-contrib/processor/groupbyattrsprocessor v0.124.1 h1:gYlUUIR+lzLQCpj5phh+Ogmk5BRaOrEuKGjIixCk89I=
github.com/open-telemetry/opentelemetry-collector-contrib/processor/groupbyattrsprocessor v0.124.1/go.mod h1:bkAXtBtShDOA8SuF8IpYbhx1BYWUEE1rW10HXXEXW/4=
github.com/open-telemetry/opentelemetry-collector-contrib/processor/groupbytraceprocessor v0.124.1 h1:6MAKxLXfQWHEadn9AgY1jWdKFTJkLYVBa+/h3Rk23lE=
github.com/open-telemetry/opentelemetry-collector-contrib/processor/groupbytraceprocessor v0.124.1/go.mod h1:6q2oIAtCuX9HklnqGPO8sWPoTAjhZX1x23O0aTR/zd0=
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor v0.124.1 h1:esSFJIhlZaZslW9EYY/Ss5zUnfkuN2qiS+7ujk73/gU=
Expand Down Expand Up @@ -1590,6 +1588,10 @@ github.com/xeipuuv/gojsonreference v0.0.0-20180127040603-bd5ef7bd5415 h1:EzJWgHo
github.com/xeipuuv/gojsonreference v0.0.0-20180127040603-bd5ef7bd5415/go.mod h1:GwrjFmJcFw6At/Gs6z4yjiIwzuJ1/+UwLxMQDVQXShQ=
github.com/xeipuuv/gojsonschema v1.2.0 h1:LhYJRs+L4fBtjZUfuSZIKGeVu0QRy8e5Xi7D17UxZ74=
github.com/xeipuuv/gojsonschema v1.2.0/go.mod h1:anYRn/JVcOK2ZgGU+IjEV4nwlhoK5sQluxsYJ78Id3Y=
github.com/yanhaoluo666/opentelemetry-collector-contrib/exporter/awsemfexporter v0.0.0-20251020112017-94065798a087 h1:i6sKcLt+bHgbJs3Hjaea5C/g2HeY8gLnZtS+Gxl+IQw=
github.com/yanhaoluo666/opentelemetry-collector-contrib/exporter/awsemfexporter v0.0.0-20251020112017-94065798a087/go.mod h1:dSu6d3FZqrAECatXDhvYsQIEAaL1iF+fokrPwCjxhC8=
github.com/yanhaoluo666/opentelemetry-collector-contrib/receiver/awscontainerinsightreceiver v0.0.0-20251013162607-385c069b9f1f h1:heA619m3+WxatwdpSaBqCpnlA719p2nvjmSpJDhDy44=
github.com/yanhaoluo666/opentelemetry-collector-contrib/receiver/awscontainerinsightreceiver v0.0.0-20251013162607-385c069b9f1f/go.mod h1:2/Yuy1ePzxKLoHdJIS/BBdWfMD+wpkudvxe1HXZuMAM=
github.com/youmark/pkcs8 v0.0.0-20201027041543-1326539a0a0a h1:fZHgsYlfvtyqToslyjUt3VOPF4J7aK/3MPcK7xp3PDk=
github.com/youmark/pkcs8 v0.0.0-20201027041543-1326539a0a0a/go.mod h1:ul22v+Nro/R083muKhosV54bj5niojjWZvU8xrevuH4=
github.com/yuin/goldmark v1.1.25/go.mod h1:3hX8gzYuyVAZsxl0MRgGTJEmQBFcNTphYh9decYSb74=
Expand Down
2 changes: 2 additions & 0 deletions service/defaultcomponents/components.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ import (
"github.com/open-telemetry/opentelemetry-collector-contrib/processor/deltatocumulativeprocessor"
"github.com/open-telemetry/opentelemetry-collector-contrib/processor/deltatorateprocessor"
"github.com/open-telemetry/opentelemetry-collector-contrib/processor/filterprocessor"
"github.com/open-telemetry/opentelemetry-collector-contrib/processor/groupbyattrsprocessor"
"github.com/open-telemetry/opentelemetry-collector-contrib/processor/groupbytraceprocessor"
"github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor"
"github.com/open-telemetry/opentelemetry-collector-contrib/processor/metricsgenerationprocessor"
Expand Down Expand Up @@ -107,6 +108,7 @@ func Factories() (otelcol.Factories, error) {
gpuattributes.NewFactory(),
kueueattributes.NewFactory(),
groupbytraceprocessor.NewFactory(),
groupbyattrsprocessor.NewFactory(),
k8sattributesprocessor.NewFactory(),
memorylimiterprocessor.NewFactory(),
metricsgenerationprocessor.NewFactory(),
Expand Down
1 change: 1 addition & 0 deletions service/defaultcomponents/components_test.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -54,6 +54,7 @@ func TestComponents(t *testing.T) {
"gpuattributes",
"kueueattributes",
"groupbytrace",
"groupbyattrs",
"k8sattributes",
"memory_limiter",
"metricstransform",
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/appsignals_and_eks_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1476,6 +1476,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: false
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: false
add_full_pod_name_metric_label: false
add_service_as_attribute: true
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/appsignals_and_k8s_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1477,6 +1477,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: false
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: false
add_full_pod_name_metric_label: false
add_service_as_attribute: true
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/appsignals_fallback_and_eks_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1476,6 +1476,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: false
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: false
add_full_pod_name_metric_label: false
add_service_as_attribute: true
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/appsignals_over_fallback_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1476,6 +1476,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: false
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: false
add_full_pod_name_metric_label: false
add_service_as_attribute: true
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/base_container_insights_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -196,6 +196,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: false
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: false
add_full_pod_name_metric_label: false
add_service_as_attribute: true
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/container_insights_jmx.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -509,6 +509,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: true
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: false
add_full_pod_name_metric_label: false
add_service_as_attribute: true
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/emf_and_kubernetes_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -650,6 +650,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: false
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: true
add_full_pod_name_metric_label: true
add_service_as_attribute: true
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/emf_and_kubernetes_with_gpu_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1409,6 +1409,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: true
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: true
add_full_pod_name_metric_label: true
add_service_as_attribute: true
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/emf_and_kubernetes_with_kueue_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -752,6 +752,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: false
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: true
add_full_pod_name_metric_label: true
add_service_as_attribute: true
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/kubernetes_on_prem_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -607,6 +607,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: false
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: true
add_full_pod_name_metric_label: true
add_service_as_attribute: true
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/kueue_container_insights_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -296,6 +296,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: false
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: false
add_full_pod_name_metric_label: false
add_service_as_attribute: true
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/log_ecs_metric_only.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -139,6 +139,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: true
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: false
add_full_pod_name_metric_label: false
add_service_as_attribute: true
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/logs_and_kubernetes_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -644,6 +644,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: false
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: true
add_full_pod_name_metric_label: true
add_service_as_attribute: true
Expand Down
1 change: 1 addition & 0 deletions translator/tocwconfig/sampleConfig/prometheus_and_kubernetes_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -649,6 +649,7 @@ processors:
receivers:
awscontainerinsightreceiver:
accelerated_compute_metrics: false
accelerated_compute_gpu_metrics_collection_interval: 1m0s
add_container_name_metric_label: true
add_full_pod_name_metric_label: true
add_service_as_attribute: true
Expand Down
Loading
Loading