You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: Solutions/EKS-logs-to-ELK/README.md
+25-27Lines changed: 25 additions & 27 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,36 +3,25 @@
3
3
4
4
A multi log solution using NetApp FSxN and Trident for collecting non-stdout logs from applications.
5
5
6
-
7
-
8
-
9
6
## The problem
10
-
* Lets say you have your default application stream but you also want to maintain an access log and an audit log, each log has its own foramt, its own wirte frequesncy and even different permissions.
11
-
* There is a need to save each type in a different file but the same goal of collecting these logs and pushing them to log aggreagtion engines/storage.
12
-
* The chalange is that these file are located on the disposible Pod storage and cannot be accessed or streamed same as std out/std error logs.
7
+
* Lets say you have your default application stream but you also want to maintain an access log and an audit log, each log has its own format, its own write frequency and even different permissions.
8
+
* There is a need to save each type in a different file but the same goal of collecting these logs and pushing them to log aggregation engines/storage.
9
+
* The challenge is that these file are located on the disposable Pod storage and cannot be accessed or streamed same as std out/std error logs.
13
10
* A more advance but still common scenario is when a container has more than one log stream / file.
14
11
15
-
16
-
17
-
18
12
## Collecting logs using FSxN Trident persistent storage
19
13
20
-
With FSxN and Trident, you can create a shared namespace persistent storage platform and collect non-stdout logs into one location (ElasticSearch, Loki, S3, etc..), overcoming the common obstacles faced when implementing multilog solutions.
14
+
With FSxN and Trident, you can create a shared namespace persistent storage platform and collect non-stdout logs into one location (ElasticSearch, Loki, S3, etc..), overcoming the common obstacles faced when implementing multi log solutions.
21
15
22
-
23
-
24
-
25
-
26
-
### Solution Architecture Example
27
16
## Getting Started
28
17
29
-
The following sections provide quickstart instructions for multiple logs shippers. All of these assume that you have cloned this repository locally and are using a CLI thats current directory is the root of the code repository.
18
+
The following section provide quick start instructions for multiple logs shippers. All of these assume that you have cloned this repository locally and you are using a CLI with its current directory set to the root of the code repository.
30
19
31
20
### Prerequisites
32
21
33
-
*`Helm` - for reources installation.
22
+
*`Helm` - for resource installation.
34
23
*`Kubectl` – for interacting with the EKS cluster.
35
-
* NetApp FSxN running on the same EKS vpc.
24
+
* NetApp FSxN running on the same EKS VPC.
36
25
* TCP NFS ports should be open between the EKS nodes and the FSxN:
37
26
`111`,
38
27
`2049`,
@@ -41,13 +30,17 @@ The following sections provide quickstart instructions for multiple logs shipper
* Kubernetes Snapshot Custom Resources (CRD) and Snapshot Controller installed on EKS cluster:
44
-
Learn more about the snapshot requirements for your cluster in the ["How to Deploy Volume Snapshots”](https://kubernetes.io/blog/2020/12/10/kubernetes-1.20-volume-snapshot-moves-to-ga/#how-to-deploy-volume-snapshots)Kuberbetes blog.
33
+
Learn more about the snapshot requirements for your cluster in the ["How to Deploy Volume Snapshots”](https://kubernetes.io/blog/2020/12/10/kubernetes-1.20-volume-snapshot-moves-to-ga/#how-to-deploy-volume-snapshots)Kubernetes blog.
45
34
* NetApp Trident operator CSI should be installed on EKS. [Check Trident installation guide using Helm](https://docs.netapp.com/us-en/trident/trident-get-started/kubernetes-deploy-helm.html#deploy-the-trident-operator-and-install-astra-trident-using-helm).
46
35
47
36
### Installation
48
37
49
38
* Configure Trident CSI backend to connect to the FSxN file system. Create the backend configuration for the trident driver. Create secret on trident namespace and fill the FSxN password:
0 commit comments