Skip to content

Commit 6bd3578

Browse files
gpop63mykola-elasticMichaelKatsoulis
authored
[aws_elb_otel] Add AWS ELB logs content pack for OpenTelemetry (#15401)
* add content pack * fix pr id * add codeowners entry * fix codeowners * rename integration to aws_elb_otel use esql queries in dashboard * fix codeowners entry * update logo * update dashboard title fix field names * update docs * add dashboard datastream filter * fix dashboard filter * address comments * use bytes for y axis * Update packages/aws_elb_otel/changelog.yml Co-authored-by: Mykola Kmet <[email protected]> * update dashboard * update dashboard * remove content pack from title * Update packages/aws_elb_otel/manifest.yml Co-authored-by: Mykola Kmet <[email protected]> * update data stream filter * fix datastream filters * fix datastream filter * Update packages/aws_elb_otel/docs/README.md Co-authored-by: Michalis Katsoulis <[email protected]> * remove datastream filter at lens lvl --------- Co-authored-by: Mykola Kmet <[email protected]> Co-authored-by: Michalis Katsoulis <[email protected]>
1 parent 6e00355 commit 6bd3578

File tree

8 files changed

+1676
-0
lines changed

8 files changed

+1676
-0
lines changed

.github/CODEOWNERS

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -205,6 +205,7 @@
205205
/packages/elastic_package_registry @elastic/ecosystem
206206
/packages/elastic_security @elastic/security-service-integrations
207207
/packages/elasticsearch @elastic/stack-monitoring
208+
/packages/aws_elb_otel @elastic/obs-infraobs-integrations
208209
/packages/endace @elastic/integration-experience @elastic/sec-linux-platform
209210
/packages/endace/data_stream/flow @elastic/sec-linux-platform
210211
/packages/endace/data_stream/log @elastic/integration-experience

packages/aws_elb_otel/LICENSE.txt

Lines changed: 93 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,93 @@
1+
Elastic License 2.0
2+
3+
URL: https://www.elastic.co/licensing/elastic-license
4+
5+
## Acceptance
6+
7+
By using the software, you agree to all of the terms and conditions below.
8+
9+
## Copyright License
10+
11+
The licensor grants you a non-exclusive, royalty-free, worldwide,
12+
non-sublicensable, non-transferable license to use, copy, distribute, make
13+
available, and prepare derivative works of the software, in each case subject to
14+
the limitations and conditions below.
15+
16+
## Limitations
17+
18+
You may not provide the software to third parties as a hosted or managed
19+
service, where the service provides users with access to any substantial set of
20+
the features or functionality of the software.
21+
22+
You may not move, change, disable, or circumvent the license key functionality
23+
in the software, and you may not remove or obscure any functionality in the
24+
software that is protected by the license key.
25+
26+
You may not alter, remove, or obscure any licensing, copyright, or other notices
27+
of the licensor in the software. Any use of the licensor’s trademarks is subject
28+
to applicable law.
29+
30+
## Patents
31+
32+
The licensor grants you a license, under any patent claims the licensor can
33+
license, or becomes able to license, to make, have made, use, sell, offer for
34+
sale, import and have imported the software, in each case subject to the
35+
limitations and conditions in this license. This license does not cover any
36+
patent claims that you cause to be infringed by modifications or additions to
37+
the software. If you or your company make any written claim that the software
38+
infringes or contributes to infringement of any patent, your patent license for
39+
the software granted under these terms ends immediately. If your company makes
40+
such a claim, your patent license ends immediately for work on behalf of your
41+
company.
42+
43+
## Notices
44+
45+
You must ensure that anyone who gets a copy of any part of the software from you
46+
also gets a copy of these terms.
47+
48+
If you modify the software, you must include in any modified copies of the
49+
software prominent notices stating that you have modified the software.
50+
51+
## No Other Rights
52+
53+
These terms do not imply any licenses other than those expressly granted in
54+
these terms.
55+
56+
## Termination
57+
58+
If you use the software in violation of these terms, such use is not licensed,
59+
and your licenses will automatically terminate. If the licensor provides you
60+
with a notice of your violation, and you cease all violation of this license no
61+
later than 30 days after you receive that notice, your licenses will be
62+
reinstated retroactively. However, if you violate these terms after such
63+
reinstatement, any additional violation of these terms will cause your licenses
64+
to terminate automatically and permanently.
65+
66+
## No Liability
67+
68+
*As far as the law allows, the software comes as is, without any warranty or
69+
condition, and the licensor will not be liable to you for any damages arising
70+
out of these terms or the use or nature of the software, under any kind of
71+
legal claim.*
72+
73+
## Definitions
74+
75+
The **licensor** is the entity offering these terms, and the **software** is the
76+
software the licensor makes available under these terms, including any portion
77+
of it.
78+
79+
**you** refers to the individual or entity agreeing to these terms.
80+
81+
**your company** is any legal entity, sole proprietorship, or other kind of
82+
organization that you work for, plus all organizations that have control over,
83+
are under the control of, or are under common control with that
84+
organization. **control** means ownership of substantially all the assets of an
85+
entity, or the power to direct its management and policies by vote, contract, or
86+
otherwise. Control can be direct or indirect.
87+
88+
**your licenses** are all the licenses granted to you for the software under
89+
these terms.
90+
91+
**use** means anything you do with the software requiring one of your licenses.
92+
93+
**trademark** means trademarks, service marks, and similar rights.
Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
# newer versions go on top
2+
- version: "0.1.0"
3+
changes:
4+
- description: Initial draft of the AWS ELB Access Logs OpenTelemetry Assets package
5+
type: enhancement
6+
link: https://github.com/elastic/integrations/pull/15401
Lines changed: 39 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,39 @@
1+
# AWS ELB Access Logs OpenTelemetry Assets
2+
3+
The AWS ELB Access Logs OpenTelemetry Assets allow you to collect and monitor ELB access logs. ELB access logs provides a visual representation of ELB traffic and request data, enabling you to monitor performance, security, and troubleshoot issues in real time.
4+
5+
The EDOT Cloud Forwarder for AWS enables you to collect **Application Load Balancer (ALB)**, **Network Load Balancer (NLB)** and **Classic Load Balancer** access logs from Amazon S3 and forward them directly into Elastic Observability (serverless).
6+
7+
## What do I need to use this integration?
8+
9+
You need an Elastic Observability project (**Serverless only**) for storing, analyzing, and visualizing your ELB logs.
10+
11+
From the AWS side, to collect ELB access logs, you need:
12+
13+
- An S3 bucket for storing the logs
14+
- A load balancer configured to export access logs to the S3 bucket. Check the [official AWS docs](https://docs.aws.amazon.com/elasticloadbalancing/latest/application/enable-access-logging.html) on how to export access logs
15+
16+
## Compatibility
17+
18+
The EDOT Cloud Forwarder for AWS supports collecting logs from:
19+
20+
* Application Load Balancers
21+
* Network Load Balancers
22+
* Classic Load Balancers
23+
24+
For the full documentation on how to set up the EDOT Cloud Forwarder, follow this link: [EDOT Cloud Forwarder for AWS](https://www.elastic.co/docs/reference/opentelemetry/edot-cloud-forwarder/aws).
25+
26+
## Logs reference
27+
28+
### AWS ELB access logs
29+
30+
AWS ELB access logs provide detailed information about requests sent to your load balancer, including:
31+
32+
* Client IP address
33+
* Target IP address
34+
* Request processing times
35+
* HTTP method, URL, and protocol
36+
* Target status code
37+
* Bytes received/sent
38+
39+
Please refer to [OpenTelemetry AWS Logs encoding extension](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/encoding/awslogsencodingextension#elb-access-log-fields) for details on log format and fields.
297 KB
Loading

packages/aws_elb_otel/img/logo.svg

Lines changed: 61 additions & 0 deletions
Loading

0 commit comments

Comments
 (0)