Skip to content

REP operation testing#16347

Open
slevenick wants to merge 2 commits intoGoogleCloudPlatform:mainfrom
slevenick:rep-testing
Open

REP operation testing#16347
slevenick wants to merge 2 commits intoGoogleCloudPlatform:mainfrom
slevenick:rep-testing

Conversation

@slevenick
Copy link
Contributor

Using to kick tests, they take a long time locally

Release Note Template for Downstream PRs (will be copied)

See Write release notes for guidance.


@modular-magician
Copy link
Collaborator

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

google provider: Diff ( 713 files changed, 1622 insertions(+), 33 deletions(-))
google-beta provider: Diff ( 786 files changed, 1761 insertions(+), 41 deletions(-))
terraform-google-conversion: Diff ( 5 files changed, 42 insertions(+), 12 deletions(-))

@modular-magician
Copy link
Collaborator

Tests analytics

Total tests: 6011
Passed tests: 5288
Skipped tests: 634
Affected tests: 89

Click here to see the affected service packages

All service packages are affected

Action taken

Found 89 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit. Click here to see the affected tests
  • TestAccAccessContextManager__service_perimeter_dry_run_egress_policy
  • TestAccAlloydbBackup_alloydbBackupBasicTestExample
  • TestAccAlloydbBackup_createBackupWithMandatoryFields
  • TestAccAlloydbBackup_update
  • TestAccAlloydbBackup_usingCMEK
  • TestAccAlloydbCluster_AutomatedBackupPolicyHandlesMidnight
  • TestAccAlloydbCluster_CMEKInAutomatedBackupIsUpdatable
  • TestAccAlloydbCluster_addAutomatedBackupPolicyAndInitialUser
  • TestAccAlloydbCluster_alloydbClusterAfterUpgradeExample
  • TestAccAlloydbCluster_alloydbClusterBasicExample
  • TestAccAlloydbCluster_alloydbClusterBeforeUpgradeExample
  • TestAccAlloydbCluster_alloydbClusterFullExample
  • TestAccAlloydbCluster_alloydbSecondaryClusterBasicTestExample
  • TestAccAlloydbCluster_continuousBackup_CMEKIsUpdatable
  • TestAccAlloydbCluster_continuousBackup_enabledByDefault
  • TestAccAlloydbCluster_continuousBackup_noChangeIfRemoved
  • TestAccAlloydbCluster_continuousBackup_update
  • TestAccAlloydbCluster_continuousBackup_update_noChangeIfDefaultsSet
  • TestAccAlloydbCluster_deleteAutomatedBackupPolicyAndInitialUser
  • TestAccAlloydbCluster_deleteTimeBasedRetentionPolicy
  • TestAccAlloydbCluster_mandatoryFields
  • TestAccAlloydbCluster_maximumFields
  • TestAccAlloydbCluster_missingWeeklySchedule
  • TestAccAlloydbCluster_restore
  • TestAccAlloydbCluster_restoreFromBackupDrBackup
  • TestAccAlloydbCluster_secondaryClusterDefinedSecondaryConfigButClusterTypeIsPrimary
  • TestAccAlloydbCluster_secondaryClusterDefinedSecondaryConfigButMissingClusterTypeSecondary
  • TestAccAlloydbCluster_secondaryClusterMandatoryFields
  • TestAccAlloydbCluster_secondaryClusterMissingSecondaryConfig
  • TestAccAlloydbCluster_secondaryClusterPromote
  • TestAccAlloydbCluster_secondaryClusterPromoteAndAddAndDeleteAutomatedBackupPolicyAndInitialUser
  • TestAccAlloydbCluster_secondaryClusterPromoteAndAddContinuousBackupConfig
  • TestAccAlloydbCluster_secondaryClusterPromoteAndDeleteOriginalPrimary
  • TestAccAlloydbCluster_secondaryClusterPromoteAndDeleteTimeBasedRetentionPolicy
  • TestAccAlloydbCluster_secondaryClusterPromoteAndSimultaneousUpdate
  • TestAccAlloydbCluster_secondaryClusterPromoteAndUpdate
  • TestAccAlloydbCluster_secondaryClusterPromoteWithNetworkConfigAndAllocatedIPRange
  • TestAccAlloydbCluster_secondaryClusterUpdate
  • TestAccAlloydbCluster_secondaryClusterUsingCMEK
  • TestAccAlloydbCluster_secondaryClusterWithNetworkConfig
  • TestAccAlloydbCluster_secondaryClusterWithNetworkConfigAndAllocatedIPRange
  • TestAccAlloydbCluster_secondaryInstanceWithNetworkConfigAndAllocatedIPRange
  • TestAccAlloydbCluster_standardClusterUpdate
  • TestAccAlloydbCluster_standardClusterUpdateFailure
  • TestAccAlloydbCluster_trialClusterUpdate
  • TestAccAlloydbCluster_update
  • TestAccAlloydbCluster_upgrade
  • TestAccAlloydbCluster_usingCMEK
  • TestAccAlloydbCluster_withMaintenanceWindows
  • TestAccAlloydbCluster_withNetworkConfig
  • TestAccAlloydbCluster_withNetworkConfigAndAllocatedIPRange
  • TestAccAlloydbCluster_withPrivateServiceConnect
  • TestAccAlloydbCluster_withSubscriptionTypeStandard
  • TestAccAlloydbCluster_withSubscriptionTypeTrial
  • TestAccAlloydbDatabaseClusterDatasourceConfig
  • TestAccAlloydbDatabaseInstanceDatasourceConfig
  • TestAccAlloydbInstance_ObservabilityConfig_Update
  • TestAccAlloydbInstance_alloydbInstanceBasicTestExample
  • TestAccAlloydbInstance_alloydbInstancePscTestExample
  • TestAccAlloydbInstance_alloydbSecondaryInstanceBasicTestExample
  • TestAccAlloydbInstance_clientConnectionConfig
  • TestAccAlloydbInstance_connectionPoolConfig
  • TestAccAlloydbInstance_createInstanceWithMandatoryFields
  • TestAccAlloydbInstance_createInstanceWithNetworkConfigAndAllocatedIPRange
  • TestAccAlloydbInstance_createInstanceWithPscInterfaceConfigs
  • TestAccAlloydbInstance_createPrimaryAndReadPoolInstance
  • TestAccAlloydbInstance_createPrimaryAndReadPoolInstanceWithAllocatedIpRangeOverride
  • TestAccAlloydbInstance_networkConfig
  • TestAccAlloydbInstance_secondaryInstanceMaximumFields
  • TestAccAlloydbInstance_secondaryInstanceUpdateDatabaseFlag
  • TestAccAlloydbInstance_secondaryInstanceUpdateMachineConfig
  • TestAccAlloydbInstance_secondaryInstanceUpdateQueryInsightConfig
  • TestAccAlloydbInstance_secondaryInstanceWithReadPoolInstance
  • TestAccAlloydbInstance_stopstart
  • TestAccAlloydbInstance_update
  • TestAccAlloydbInstance_updateInstanceWithPscInterfaceConfigs
  • TestAccAlloydbInstance_updatePscAutoConnections
  • TestAccAlloydbInstance_updatePscInstanceConfig
  • TestAccAlloydbUser_alloydbUserBuiltinTestExample
  • TestAccAlloydbUser_alloydbUserBuiltinWithPasswordWo
  • TestAccAlloydbUser_alloydbUserBuiltinWithPasswordWo_update
  • TestAccAlloydbUser_alloydbUserIamTestExample
  • TestAccAlloydbUser_updatePassword_BuiltIn
  • TestAccAlloydbUser_updateRoles_BuiltIn
  • TestAccAlloydbUser_updateRoles_IAM
  • TestAccDataSourceAlloydbLocations_basic
  • TestAccDataSourceAlloydbSupportedDatabaseFlags_basic
  • TestAccDatabaseMigrationServiceConnectionProfile_databaseMigrationServiceConnectionProfileExistingAlloydbExample
  • TestAccDatabaseMigrationServiceMigrationJob_databaseMigrationServiceMigrationJobPostgresToAlloydbExample

Get to know how VCR tests work

@modular-magician
Copy link
Collaborator

🟢 Tests passed during RECORDING mode:
TestAccAccessContextManager__access_level [Debug log]
TestAccAccessContextManager__access_level_condition [Debug log]
TestAccAccessContextManager__access_level_custom [Debug log]
TestAccAccessContextManager__access_level_full [Debug log]
TestAccAccessContextManager__access_levels [Debug log]
TestAccAccessContextManager__access_policy [Debug log]
TestAccAccessContextManager__access_policy_scoped [Debug log]
TestAccAccessContextManager__authorized_orgs_desc [Debug log]
TestAccAccessContextManager__service_perimeter [Debug log]
TestAccAccessContextManager__service_perimeter_dry_run_egress_policy [Debug log]
TestAccAccessContextManager__service_perimeter_dry_run_ingress_policy [Debug log]
TestAccAccessContextManager__service_perimeter_update [Debug log]
TestAccAccessContextManager__service_perimeters [Debug log]
TestAccAlloydbBackup_alloydbBackupBasicTestExample [Debug log]
TestAccAlloydbBackup_createBackupWithMandatoryFields [Debug log]
TestAccAlloydbBackup_update [Debug log]
TestAccAlloydbBackup_usingCMEK [Debug log]
TestAccAlloydbCluster_AutomatedBackupPolicyHandlesMidnight [Debug log]
TestAccAlloydbCluster_CMEKInAutomatedBackupIsUpdatable [Debug log]
TestAccAlloydbCluster_addAutomatedBackupPolicyAndInitialUser [Debug log]
TestAccAlloydbCluster_alloydbClusterAfterUpgradeExample [Debug log]
TestAccAlloydbCluster_alloydbClusterBasicExample [Debug log]
TestAccAlloydbCluster_alloydbClusterBeforeUpgradeExample [Debug log]
TestAccAlloydbCluster_alloydbClusterFullExample [Debug log]
TestAccAlloydbCluster_alloydbSecondaryClusterBasicTestExample [Debug log]
TestAccAlloydbCluster_continuousBackup_CMEKIsUpdatable [Debug log]
TestAccAlloydbCluster_continuousBackup_enabledByDefault [Debug log]
TestAccAlloydbCluster_continuousBackup_noChangeIfRemoved [Debug log]
TestAccAlloydbCluster_continuousBackup_update [Debug log]
TestAccAlloydbCluster_continuousBackup_update_noChangeIfDefaultsSet [Debug log]
TestAccAlloydbCluster_deleteAutomatedBackupPolicyAndInitialUser [Debug log]
TestAccAlloydbCluster_deleteTimeBasedRetentionPolicy [Debug log]
TestAccAlloydbCluster_mandatoryFields [Debug log]
TestAccAlloydbCluster_maximumFields [Debug log]
TestAccAlloydbCluster_missingWeeklySchedule [Debug log]
TestAccAlloydbCluster_restore [Debug log]
TestAccAlloydbCluster_restoreFromBackupDrBackup [Debug log]
TestAccAlloydbCluster_secondaryClusterDefinedSecondaryConfigButClusterTypeIsPrimary [Debug log]
TestAccAlloydbCluster_secondaryClusterDefinedSecondaryConfigButMissingClusterTypeSecondary [Debug log]
TestAccAlloydbCluster_secondaryClusterMandatoryFields [Debug log]
TestAccAlloydbCluster_secondaryClusterMissingSecondaryConfig [Debug log]
TestAccAlloydbCluster_secondaryClusterPromote [Debug log]
TestAccAlloydbCluster_secondaryClusterPromoteAndAddAndDeleteAutomatedBackupPolicyAndInitialUser [Debug log]
TestAccAlloydbCluster_secondaryClusterPromoteAndAddContinuousBackupConfig [Debug log]
TestAccAlloydbCluster_secondaryClusterPromoteAndDeleteOriginalPrimary [Debug log]
TestAccAlloydbCluster_secondaryClusterPromoteAndDeleteTimeBasedRetentionPolicy [Debug log]
TestAccAlloydbCluster_secondaryClusterPromoteAndSimultaneousUpdate [Debug log]
TestAccAlloydbCluster_secondaryClusterPromoteAndUpdate [Debug log]
TestAccAlloydbCluster_secondaryClusterPromoteWithNetworkConfigAndAllocatedIPRange [Debug log]
TestAccAlloydbCluster_secondaryClusterUpdate [Debug log]
TestAccAlloydbCluster_secondaryClusterUsingCMEK [Debug log]
TestAccAlloydbCluster_secondaryClusterWithNetworkConfig [Debug log]
TestAccAlloydbCluster_secondaryClusterWithNetworkConfigAndAllocatedIPRange [Debug log]
TestAccAlloydbCluster_secondaryInstanceWithNetworkConfigAndAllocatedIPRange [Debug log]
TestAccAlloydbCluster_standardClusterUpdate [Debug log]
TestAccAlloydbCluster_standardClusterUpdateFailure [Debug log]
TestAccAlloydbCluster_trialClusterUpdate [Debug log]
TestAccAlloydbCluster_update [Debug log]
TestAccAlloydbCluster_upgrade [Debug log]
TestAccAlloydbCluster_usingCMEK [Debug log]
TestAccAlloydbCluster_withMaintenanceWindows [Debug log]
TestAccAlloydbCluster_withNetworkConfig [Debug log]
TestAccAlloydbCluster_withNetworkConfigAndAllocatedIPRange [Debug log]
TestAccAlloydbCluster_withPrivateServiceConnect [Debug log]
TestAccAlloydbCluster_withSubscriptionTypeStandard [Debug log]
TestAccAlloydbCluster_withSubscriptionTypeTrial [Debug log]
TestAccAlloydbDatabaseClusterDatasourceConfig [Debug log]
TestAccAlloydbDatabaseInstanceDatasourceConfig [Debug log]
TestAccAlloydbInstance_ObservabilityConfig_Update [Debug log]
TestAccAlloydbInstance_alloydbInstanceBasicTestExample [Debug log]
TestAccAlloydbInstance_alloydbInstancePscTestExample [Debug log]
TestAccAlloydbInstance_alloydbSecondaryInstanceBasicTestExample [Debug log]
TestAccAlloydbInstance_clientConnectionConfig [Debug log]
TestAccAlloydbInstance_connectionPoolConfig [Debug log]
TestAccAlloydbInstance_createInstanceWithMandatoryFields [Debug log]
TestAccAlloydbInstance_createInstanceWithNetworkConfigAndAllocatedIPRange [Debug log]
TestAccAlloydbInstance_createInstanceWithPscInterfaceConfigs [Debug log]
TestAccAlloydbInstance_createPrimaryAndReadPoolInstance [Debug log]
TestAccAlloydbInstance_createPrimaryAndReadPoolInstanceWithAllocatedIpRangeOverride [Debug log]
TestAccAlloydbInstance_networkConfig [Debug log]
TestAccAlloydbInstance_secondaryInstanceMaximumFields [Debug log]
TestAccAlloydbInstance_secondaryInstanceUpdateDatabaseFlag [Debug log]
TestAccAlloydbInstance_secondaryInstanceUpdateMachineConfig [Debug log]
TestAccAlloydbInstance_secondaryInstanceUpdateQueryInsightConfig [Debug log]
TestAccAlloydbInstance_secondaryInstanceWithReadPoolInstance [Debug log]
TestAccAlloydbInstance_stopstart [Debug log]
TestAccAlloydbInstance_update [Debug log]
TestAccAlloydbInstance_updateInstanceWithPscInterfaceConfigs [Debug log]
TestAccAlloydbInstance_updatePscAutoConnections [Debug log]
TestAccAlloydbInstance_updatePscInstanceConfig [Debug log]
TestAccAlloydbUser_alloydbUserBuiltinTestExample [Debug log]
TestAccAlloydbUser_alloydbUserBuiltinWithPasswordWo [Debug log]
TestAccAlloydbUser_alloydbUserBuiltinWithPasswordWo_update [Debug log]
TestAccAlloydbUser_alloydbUserIamTestExample [Debug log]
TestAccAlloydbUser_updatePassword_BuiltIn [Debug log]
TestAccAlloydbUser_updateRoles_BuiltIn [Debug log]
TestAccAlloydbUser_updateRoles_IAM [Debug log]
TestAccDataSourceAlloydbSupportedDatabaseFlags_basic [Debug log]
TestAccDatabaseMigrationServiceConnectionProfile_databaseMigrationServiceConnectionProfileExistingAlloydbExample [Debug log]
TestAccDatabaseMigrationServiceMigrationJob_databaseMigrationServiceMigrationJobPostgresToAlloydbExample [Debug log]

🔴 Tests failed when rerunning REPLAYING mode:
TestAccAccessContextManager__service_perimeter_dry_run_ingress_policy [Error message] [Debug log]

Tests failed due to non-determinism or randomness when the VCR replayed the response after the HTTP request was made.

Please fix these to complete your PR. If you believe these test failures to be incorrect or unrelated to your change, or if you have any questions, please raise the concern with your reviewer.


🔴 Tests failed during RECORDING mode:
TestAccDataSourceAlloydbLocations_basic [Error message] [Debug log]

🔴 Errors occurred during RECORDING mode. Please fix them to complete your PR.

View the build log or the debug log for each test

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants