Skip to content

Commit 57dcc74

Browse files
author
Mike Ray (Microsoft)
committed
Update automated integration testing
1 parent 7dda776 commit 57dcc74

File tree

1 file changed

+28
-28
lines changed

1 file changed

+28
-28
lines changed

‎articles/azure-arc/data/automated-integration-testing.md

Lines changed: 28 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -430,38 +430,38 @@ There are approximately **375** unique integration tests available, across **27*
430430
431431
| Suite # | Test suite name | Description of test |
432432
| ------- | ------------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------ |
433-
| 1 | ad-connector | Tests the deployment and update of an Active Directory Connector (AD Connector). |
434-
| 2 | billing | Testing various Business Critical license types are reflected in resource table in controller, used for Billing upload. |
435-
| 3 | ci-billing | Similar as `billing`, but with more CPU/Memory permutations. |
436-
| 4 | ci-sqlinstance | Long running tests for multi-replica creation, updates, GP -> BC Update, Backup validation and SQL Server Agent. |
437-
| 5 | controldb | Tests Control database - SA secret check, system login verification, audit creation, and sanity checks for SQL build version. |
438-
| 6 | dc-export | Indirect Mode billing and usage upload. |
439-
| 7 | direct-crud | Creates a SQL instance using ARM calls, validates in both Kubernetes and ARM. |
440-
| 8 | direct-fog | Creates multiple SQL instances and creates a Failover Group between them using ARM calls. |
441-
| 9 | direct-hydration | Creates SQL Instance with Kubernetes API, validates presence in ARM. |
442-
| 10 | direct-upload | Validates billing upload in Direct Mode |
443-
| 11 | kube-rbac | Ensures Kubernetes Service Account permissions for Arc Data Services matches least-privilege expectations. |
444-
| 12 | nonroot | Ensures containers run as non-root user |
445-
| 13 | postgres | Various Postgres creation, scaling, backup/restore tests. |
446-
| 14 | release-sanitychecks | Sanity checks for month-to-month releases, such as SQL Server Build versions. |
447-
| 15 | sqlinstance | Shorter version of `ci-sqlinstance`, for fast validations. |
448-
| 16 | sqlinstance-ad | Tests creation of SQL Instances with Active Directory Connector. |
449-
| 17 | sqlinstance-credentialrotation | Tests automated Credential Rotation for both General Purpose and Business Critical. |
450-
| 18 | sqlinstance-ha | Various High Availability Stress tests, including pod reboots, forced failovers and suspensions. |
451-
| 19 | sqlinstance-tde | Various Transparent Data Encryption tests. |
452-
| 20 | telemetry-elasticsearch | Validates Log ingestion into Elasticsearch. |
453-
| 21 | telemetry-grafana | Validates Grafana is reachable. |
454-
| 22 | telemetry-influxdb | Validates Metric ingestion into InfluxDB. |
455-
| 23 | telemetry-kafka | Various tests for Kafka using SSL, single/multi-broker setup. |
456-
| 24 | telemetry-monitorstack | Tests Monitoring components, such as Fluentbit and Collectd are functional. |
457-
| 25 | telemetry-telemetryrouter | Tests Open Telemetry. |
458-
| 26 | telemetry-webhook | Tests Data Services Webhooks with valid and invalid calls. |
459-
| 27 | upgrade-arcdata | Upgrades a full suite of SQL Instances (GP, BC 2 replica, BC 3 replica, with Active Directory) and upgrades from last month's release to latest build. |
433+
| 1 | `ad-connector` | Tests the deployment and update of an Active Directory Connector (AD Connector). |
434+
| 2 | `billing` | Testing various Business Critical license types are reflected in resource table in controller, used for Billing upload. |
435+
| 3 | `ci-billing` | Similar as `billing`, but with more CPU/Memory permutations. |
436+
| 4 | `ci-sqlinstance` | Long running tests for multi-replica creation, updates, GP -> BC Update, Backup validation and SQL Server Agent. |
437+
| 5 | `controldb` | Tests Control database - SA secret check, system login verification, audit creation, and sanity checks for SQL build version. |
438+
| 6 | `dc-export` | Indirect Mode billing and usage upload. |
439+
| 7 | `direct-crud` | Creates a SQL instance using ARM calls, validates in both Kubernetes and ARM. |
440+
| 8 | `direct-fog` | Creates multiple SQL instances and creates a Failover Group between them using ARM calls. |
441+
| 9 | `direct-hydration` | Creates SQL Instance with Kubernetes API, validates presence in ARM. |
442+
| 10 | `direct-upload` | Validates billing upload in Direct Mode |
443+
| 11 | `kube-rbac` | Ensures Kubernetes Service Account permissions for Arc Data Services matches least-privilege expectations. |
444+
| 12 | `nonroot` | Ensures containers run as non-root user |
445+
| 13 | `postgres` | Completes various Postgres creation, scaling, backup/restore tests. |
446+
| 14 | `release-sanitychecks` | Sanity checks for month-to-month releases, such as SQL Server Build versions. |
447+
| 15 | `sqlinstance` | Shorter version of `ci-sqlinstance`, for fast validations. |
448+
| 16 | `sqlinstance-ad` | Tests creation of SQL Instances with Active Directory Connector. |
449+
| 17 | `sqlinstance-credentialrotation` | Tests automated Credential Rotation for both General Purpose and Business Critical. |
450+
| 18 | `sqlinstance-ha` | Various High Availability Stress tests, including pod reboots, forced failovers and suspensions. |
451+
| 19 | `sqlinstance-tde` | Various Transparent Data Encryption tests. |
452+
| 20 | `telemetry-elasticsearch` | Validates Log ingestion into Elasticsearch. |
453+
| 21 | `telemetry-grafana` | Validates Grafana is reachable. |
454+
| 22 | `telemetry-influxdb` | Validates Metric ingestion into InfluxDB. |
455+
| 23 | `telemetry-kafka` | Various tests for Kafka using SSL, single/multi-broker setup. |
456+
| 24 | `telemetry-monitorstack` | Tests Monitoring components, such as `Fluentbit` and `Collectd` are functional. |
457+
| 25 | `telemetry-telemetryrouter` | Tests Open Telemetry. |
458+
| 26 | `telemetry-webhook` | Tests Data Services Webhooks with valid and invalid calls. |
459+
| 27 | `upgrade-arcdata` | Upgrades a full suite of SQL Instances (GP, BC 2 replica, BC 3 replica, with Active Directory) and upgrades from last month's release to latest build. |
460460

461461
As an example, for `sqlinstance-ha`, the following tests are performed:
462462

463463
- `test_critical_configmaps_present`: Ensures the ConfigMaps and relevant fields are present for a SQL Instance.
464-
- `test_suspended_system_dbs_auto_heal_by_orchestrator`: Ensures if master and msdb is suspended by any means (in this case, user), Orchestrator maintenance reconcile auto-heals it.
464+
- `test_suspended_system_dbs_auto_heal_by_orchestrator`: Ensures if `master` and `msdb` are suspended by any means (in this case, user). Orchestrator maintenance reconcile auto-heals it.
465465
- `test_suspended_user_db_does_not_auto_heal_by_orchestrator`: Ensures if a User Database is deliberately suspended by user, Orchestrator maintenance reconcile does not auto-heal it.
466466
- `test_delete_active_orchestrator_twice_and_delete_primary_pod`: Deletes orchestrator pod multiple times, followed by the primary replica, and verifies all replicas are synchronized. Failover time expectations for 2 replica are relaxed.
467467
- `test_delete_primary_pod`: Deletes primary replica and verifies all replicas are synchronized. Failover time expectations for 2 replica are relaxed.

0 commit comments

Comments
 (0)