Skip to content

Commit c4f33b8

Browse files
daviddetorresdaviddetorres
authored
Merge pull request #149 from sysdiglabs/staging
Production deployment
2 parents e92f755 + 9b58628 commit c4f33b8

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

46 files changed

+6797
-418
lines changed

‎apps/mysql.yaml‎

Lines changed: 3 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -4,13 +4,12 @@ kind: App
44
name: "mysql"
55
keywords:
66
- Database
7-
- Coming soon
7+
- Available
88
availableVersions:
9-
- '5.6'
10-
- '5.7'
9+
- '5.7to8.0'
1110
shortDescription: "MySQL is an open-source relational database management system (RDBMS)"
1211
description: |
1312
MySQL is an open-source relational database management system (RDBMS)
1413
icon: https://raw.githubusercontent.com/sysdiglabs/promcat-resources/master/apps/images/MySQL.png
1514
website: https://dev.mysql.com/
16-
available: false
15+
available: true

‎apps/postgresql.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ keywords:
66
- Database
77
- Available
88
availableVersions:
9-
- '<=12'
9+
- '12'
1010
shortDescription: "PostgreSQL is a free and open-source relational database management system (RDBMS)"
1111
description: |
1212
PostgreSQL is a free and open-source relational database management system (RDBMS) emphasizing extensibility and technical standards compliance.

‎apps/redis.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ keywords:
66
- Database
77
- Available
88
availableVersions:
9-
- '<=6'
9+
- '2-6'
1010
shortDescription: "Redis is an open source in-memory database, cache and message broker."
1111
description: |
1212
Redis is an open source (BSD licensed), in-memory data structure store, used as a database, cache and message broker.

‎resources/cassandra/INSTALL.md‎

Lines changed: 0 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,3 @@
1-
# Prerequisites
2-
The cassandra exporter generates a high number of metrics. As the Sysdig Agent has a limit of time series that can send to Sysdig Monitor, you have to deploy a Prometheus server and create the recording rules that we provide to filter only the metrics used in dashboards and alerts.
3-
4-
To deploy a Prometheus server you will need:
5-
* [helm](https://helm.sh/docs/intro/install/)
6-
* [helmfile](https://github.com/roboll/helmfile)
7-
81
# Installing the exporter
92
Cassandra expose the metrics with jmx and the exporter gather this metrics and expose them in Prometheus format. Usually jmx is unsecured and it has not user or password. In this case, the best way to deploy it is to add a sidecar with the exporter.
103

@@ -30,23 +23,6 @@ Cassandra expose the metrics with jmx and the exporter gather this metrics and e
3023
initialDelaySeconds: 180
3124
timeoutSeconds: 45
3225
```
33-
34-
# Installing and configuring Prometheus
35-
## Installing a new Prometheus with helm
36-
In this section we will explain how to install and configure a new prometheus server with the recording rules.
37-
38-
Download the following files:
39-
- helmfile.yaml
40-
- recording_rules.yaml
41-
- prometheus.yaml
42-
- prometheus.yml.gotmpl
43-
44-
execute
45-
46-
```
47-
helmfile sync
48-
```
49-
5026
# Sysdig Agent configuration
5127
To use the Sysdig agent, first create the recording rules to scrape only the metrics that will be use in the dashboards.
5228

‎resources/cassandra/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@
1818
* Memory_total
1919

2020
# Number of time series generated
21-
The metrics filtered are around 600
21+
The metrics for each instance are around 7k
2222

2323
# Attributions
2424
Using the [Cassandra exporter](https://github.com/instaclustr/cassandra-exporter) with license Apache 2.0

‎resources/cassandra/RECORDING-RULES.md‎

Lines changed: 0 additions & 2 deletions
This file was deleted.

‎resources/cassandra/include/dashboard-Grafana--1.0.0.json‎

Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -107,7 +107,7 @@
107107
"pluginVersion": "7.0.3",
108108
"targets": [
109109
{
110-
"expr": "sum(up:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)",
110+
"expr": "sum(up * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)",
111111
"interval": "",
112112
"legendFormat": "",
113113
"refId": "A"
@@ -163,7 +163,7 @@
163163
"pluginVersion": "7.0.3",
164164
"targets": [
165165
{
166-
"expr": "avg(cassandra_client_request_latency_seconds:cassandra{operation=\"read\"}* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)",
166+
"expr": "avg(cassandra_client_request_latency_seconds{operation=\"read\"}* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)",
167167
"interval": "",
168168
"legendFormat": "",
169169
"refId": "A"
@@ -219,7 +219,7 @@
219219
"pluginVersion": "7.0.3",
220220
"targets": [
221221
{
222-
"expr": "avg(cassandra_client_request_latency_seconds:cassandra{operation=\"write\"}* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)",
222+
"expr": "avg(cassandra_client_request_latency_seconds{operation=\"write\"}* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)",
223223
"interval": "",
224224
"legendFormat": "",
225225
"refId": "A"
@@ -280,7 +280,7 @@
280280
"pluginVersion": "7.0.3",
281281
"targets": [
282282
{
283-
"expr": "(sum(cassandra_jvm_memory_pool_used_bytes:cassandra{type=\"HEAP\"} * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster) / sum(cassandra_jvm_memory_pool_maximum_bytes:cassandra{type=\"HEAP\"}* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)) * 100\n",
283+
"expr": "(sum(cassandra_jvm_memory_pool_used_bytes{type=\"HEAP\"} * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster) / sum(cassandra_jvm_memory_pool_maximum_bytes{type=\"HEAP\"}* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)) * 100\n",
284284
"interval": "",
285285
"legendFormat": "",
286286
"refId": "A"
@@ -336,7 +336,7 @@
336336
"pluginVersion": "7.0.3",
337337
"targets": [
338338
{
339-
"expr": "sum(cassandra_table_estimated_pending_compactions:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)\n",
339+
"expr": "sum(cassandra_table_estimated_pending_compactions * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)\n",
340340
"interval": "",
341341
"legendFormat": "",
342342
"refId": "A"
@@ -392,7 +392,7 @@
392392
"pluginVersion": "7.0.3",
393393
"targets": [
394394
{
395-
"expr": "sum(cassandra_commit_log_pending_tasks:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)\n",
395+
"expr": "sum(cassandra_commit_log_pending_tasks * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)\n",
396396
"interval": "",
397397
"legendFormat": "",
398398
"refId": "A"
@@ -448,7 +448,7 @@
448448
"pluginVersion": "7.0.3",
449449
"targets": [
450450
{
451-
"expr": "sum(rate(cassandra_client_request_unavailable_exceptions_total:cassandra[5m]) * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)\n",
451+
"expr": "sum(rate(cassandra_client_request_unavailable_exceptions_total[5m]) * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)\n",
452452
"interval": "",
453453
"legendFormat": "",
454454
"refId": "A"
@@ -505,7 +505,7 @@
505505
"pluginVersion": "7.0.3",
506506
"targets": [
507507
{
508-
"expr": "(sum(cassandra_storage_filesystem_usable_bytes:cassandra* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)/sum(cassandra_storage_filesystem_bytes_total:cassandra* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)) * 100",
508+
"expr": "(sum(cassandra_storage_filesystem_usable_bytes* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)/sum(cassandra_storage_filesystem_bytes_total* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}) by (cluster)) * 100",
509509
"interval": "",
510510
"legendFormat": "",
511511
"refId": "A"
@@ -563,7 +563,7 @@
563563
"steppedLine": false,
564564
"targets": [
565565
{
566-
"expr": "cassandra_client_request_latency_seconds:cassandra{quantile=\"0.95\", operation=\"read\"} * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
566+
"expr": "cassandra_client_request_latency_seconds{quantile=\"0.95\", operation=\"read\"} * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
567567
"interval": "",
568568
"legendFormat": "{{consistency}} {{instance}}",
569569
"refId": "A"
@@ -657,7 +657,7 @@
657657
"steppedLine": false,
658658
"targets": [
659659
{
660-
"expr": "cassandra_client_request_latency_seconds:cassandra{quantile=\"0.95\", operation=\"write\"} * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
660+
"expr": "cassandra_client_request_latency_seconds{quantile=\"0.95\", operation=\"write\"} * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
661661
"interval": "",
662662
"legendFormat": "{{consistency}} {{instance}}",
663663
"refId": "A"
@@ -751,7 +751,7 @@
751751
"steppedLine": false,
752752
"targets": [
753753
{
754-
"expr": "cassandra_storage_filesystem_usable_bytes:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
754+
"expr": "cassandra_storage_filesystem_usable_bytes * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
755755
"interval": "",
756756
"legendFormat": "{{instance}}",
757757
"refId": "A"
@@ -845,7 +845,7 @@
845845
"steppedLine": false,
846846
"targets": [
847847
{
848-
"expr": "cassandra_client_native_connections:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
848+
"expr": "cassandra_client_native_connections * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
849849
"interval": "",
850850
"legendFormat": "{{instance}}",
851851
"refId": "A"
@@ -939,7 +939,7 @@
939939
"steppedLine": false,
940940
"targets": [
941941
{
942-
"expr": "cassandra_os_1m_load_average:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
942+
"expr": "cassandra_os_1m_load_average * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
943943
"interval": "",
944944
"legendFormat": "{{instance}}",
945945
"refId": "A"
@@ -1033,13 +1033,13 @@
10331033
"steppedLine": false,
10341034
"targets": [
10351035
{
1036-
"expr": "cassandra_os_free_memory_bytes:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
1036+
"expr": "cassandra_os_free_memory_bytes * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
10371037
"interval": "",
10381038
"legendFormat": "Memory free - {{instance}}",
10391039
"refId": "A"
10401040
},
10411041
{
1042-
"expr": "cassandra_os_memory_bytes_total:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
1042+
"expr": "cassandra_os_memory_bytes_total * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~\"$cluster\"}",
10431043
"interval": "",
10441044
"legendFormat": "Memory total - {{instance}}",
10451045
"refId": "B"

‎resources/cassandra/include/dashboard-Sysdig--1.0.0.json‎

Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -129,7 +129,7 @@
129129
"unit": "number",
130130
"yAxis": "auto"
131131
},
132-
"query": "sum(up:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)"
132+
"query": "sum(up * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)"
133133
}
134134
],
135135
"description": "",
@@ -160,7 +160,7 @@
160160
"unit": "relativeTime",
161161
"yAxis": "auto"
162162
},
163-
"query": "avg(cassandra_client_request_latency_seconds:cassandra{operation=\"write\"}* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)"
163+
"query": "avg(cassandra_client_request_latency_seconds{operation=\"write\"}* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)"
164164
}
165165
],
166166
"description": "",
@@ -191,7 +191,7 @@
191191
"unit": "relativeTime",
192192
"yAxis": "auto"
193193
},
194-
"query": "avg(cassandra_client_request_latency_seconds:cassandra{operation=\"read\"}* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)"
194+
"query": "avg(cassandra_client_request_latency_seconds{operation=\"read\"}* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)"
195195
}
196196
],
197197
"description": "",
@@ -222,7 +222,7 @@
222222
"unit": "%",
223223
"yAxis": "auto"
224224
},
225-
"query": "(sum(cassandra_jvm_memory_pool_used_bytes:cassandra{type=\"HEAP\"} * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster) / sum(cassandra_jvm_memory_pool_maximum_bytes:cassandra{type=\"HEAP\"}* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)) * 100\n"
225+
"query": "(sum(cassandra_jvm_memory_pool_used_bytes{type=\"HEAP\"} * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster) / sum(cassandra_jvm_memory_pool_maximum_bytes{type=\"HEAP\"}* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)) * 100\n"
226226
}
227227
],
228228
"description": "",
@@ -253,7 +253,7 @@
253253
"unit": "number",
254254
"yAxis": "auto"
255255
},
256-
"query": "sum(cassandra_table_estimated_pending_compactions:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)\n"
256+
"query": "sum(cassandra_table_estimated_pending_compactions * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)\n"
257257
}
258258
],
259259
"description": "",
@@ -284,7 +284,7 @@
284284
"unit": "number",
285285
"yAxis": "auto"
286286
},
287-
"query": "sum(cassandra_commit_log_pending_tasks:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)\n"
287+
"query": "sum(cassandra_commit_log_pending_tasks * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)\n"
288288
}
289289
],
290290
"description": "",
@@ -315,7 +315,7 @@
315315
"unit": "number",
316316
"yAxis": "auto"
317317
},
318-
"query": "sum(rate(cassandra_client_request_unavailable_exceptions_total:cassandra[5m]) * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)\n"
318+
"query": "sum(rate(cassandra_client_request_unavailable_exceptions_total[5m]) * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)\n"
319319
}
320320
],
321321
"description": "",
@@ -346,7 +346,7 @@
346346
"unit": "%",
347347
"yAxis": "auto"
348348
},
349-
"query": "(sum(cassandra_storage_filesystem_usable_bytes:cassandra* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)/sum(cassandra_storage_filesystem_bytes_total:cassandra* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)) * 100"
349+
"query": "(sum(cassandra_storage_filesystem_usable_bytes* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)/sum(cassandra_storage_filesystem_bytes_total* on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}) by (cluster)) * 100"
350350
}
351351
],
352352
"description": "",
@@ -377,7 +377,7 @@
377377
"unit": "relativeTime",
378378
"yAxis": "auto"
379379
},
380-
"query": "cassandra_client_request_latency_seconds:cassandra{quantile=\"0.95\", operation=\"read\"} * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
380+
"query": "cassandra_client_request_latency_seconds{quantile=\"0.95\", operation=\"read\"} * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
381381
}
382382
],
383383
"axesConfiguration": {
@@ -436,7 +436,7 @@
436436
"unit": "relativeTime",
437437
"yAxis": "auto"
438438
},
439-
"query": "cassandra_client_request_latency_seconds:cassandra{quantile=\"0.95\", operation=\"write\"} * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
439+
"query": "cassandra_client_request_latency_seconds{quantile=\"0.95\", operation=\"write\"} * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
440440
}
441441
],
442442
"axesConfiguration": {
@@ -495,7 +495,7 @@
495495
"unit": "byte",
496496
"yAxis": "auto"
497497
},
498-
"query": "cassandra_storage_filesystem_usable_bytes:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
498+
"query": "cassandra_storage_filesystem_usable_bytes * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
499499
}
500500
],
501501
"axesConfiguration": {
@@ -554,7 +554,7 @@
554554
"unit": "number",
555555
"yAxis": "auto"
556556
},
557-
"query": "cassandra_client_native_connections:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
557+
"query": "cassandra_client_native_connections * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
558558
}
559559
],
560560
"axesConfiguration": {
@@ -613,7 +613,7 @@
613613
"unit": "number",
614614
"yAxis": "auto"
615615
},
616-
"query": "cassandra_os_1m_load_average:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
616+
"query": "cassandra_os_1m_load_average * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
617617
}
618618
],
619619
"axesConfiguration": {
@@ -672,7 +672,7 @@
672672
"unit": "byte",
673673
"yAxis": "auto"
674674
},
675-
"query": "cassandra_os_free_memory_bytes:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
675+
"query": "cassandra_os_free_memory_bytes * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
676676
},
677677
{
678678
"displayInfo": {
@@ -688,7 +688,7 @@
688688
"unit": "byte",
689689
"yAxis": "auto"
690690
},
691-
"query": "cassandra_os_memory_bytes_total:cassandra * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
691+
"query": "cassandra_os_memory_bytes_total * on (container_id) group_left(cluster,namespace,pod) sysdig_container_info{cluster=~$cluster}"
692692
}
693693
],
694694
"axesConfiguration": {

0 commit comments

Comments
 (0)