Skip to content

Commit 697b995

Browse files
committed
GCS cloudbuild e2e fixes
1 parent a1a4049 commit 697b995

File tree

3 files changed

+8
-4
lines changed

3 files changed

+8
-4
lines changed

src/e2e-test/features/gcs/source/GCSToGCSAdditonalTests.feature

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -266,10 +266,12 @@ Feature: GCS source - Verification of GCS to GCS Additional Tests successful
266266
Then Deploy the pipeline
267267
Then Run the Pipeline in Runtime
268268
Then Wait till pipeline is in running state
269+
Then Open and capture logs
269270
And Verify the pipeline status is "Failed"
271+
Then Close the pipeline logs
270272
Then Open Pipeline logs and verify Log entries having below listed Level and Message:
271273
| Level | Message |
272-
| ERROR | errorMessageMultipleFileWithFirstRowAsHeaderEnabled |
274+
| WARN | errorMessageMultipleFileWithFirstRowAsHeaderEnabled |
273275

274276
@GCS_MULTIPLE_FILES_TEST @GCS_SINK_TEST @GCS_Source_Required @ITN_TEST
275277
Scenario: To verify the pipeline is getting failed from GCS to GCS when default schema is not cleared in GCS source On Multiple File
@@ -300,7 +302,9 @@ Feature: GCS source - Verification of GCS to GCS Additional Tests successful
300302
Then Deploy the pipeline
301303
Then Run the Pipeline in Runtime
302304
Then Wait till pipeline is in running state
305+
Then Open and capture logs
303306
And Verify the pipeline status is "Failed"
307+
Then Close the pipeline logs
304308
Then Open Pipeline logs and verify Log entries having below listed Level and Message:
305309
| Level | Message |
306310
| ERROR | errorMessageMultipleFileWithoutClearDefaultSchema |

src/e2e-test/resources/errorMessage.properties

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,8 +28,8 @@ errorMessageInvalidBucketName=Invalid bucket name in path
2828
errorMessageInvalidFormat=Input has multi-level structure that cannot be represented appropriately as csv. \
2929
Consider using json, avro or parquet to write data.
3030
errorMessageMultipleFileWithFirstRowAsHeaderDisabled=Spark program 'phase-1' failed with error: Found a row with 6 fields when the schema only contains 4 fields. Check that the schema contains the right number of fields.. Please check the system logs for more details.
31-
errorMessageMultipleFileWithFirstRowAsHeaderEnabled=Spark program 'phase-1' failed with error: For input string:
32-
errorMessageMultipleFileWithoutClearDefaultSchema=Spark program 'phase-1' failed with error: Found a row with 4 fields when the schema only contains 2 fields.
31+
errorMessageMultipleFileWithFirstRowAsHeaderEnabled=NumberFormatException
32+
errorMessageMultipleFileWithoutClearDefaultSchema=Found a row with 4 fields when the schema only contains 2 fields
3333
errorMessageInvalidSourcePath=Invalid bucket name in path 'abc@'. Bucket name should
3434
errorMessageInvalidDestPath=Invalid bucket name in path 'abc@'. Bucket name should
3535
errorMessageInvalidEncryptionKey=CryptoKeyName.parse: formattedString not in valid format: Parameter "abc@" must be

src/e2e-test/resources/pluginParameters.properties

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
projectId=cdf-athena
22
datasetprojectId=cdf-athena
3-
dataset=testing_bqmt
3+
dataset=testinge2e_dataset
44
wrongSourcePath=gs://00000000-e2e-0014a44f-81be-4501-8360-0ddca192492
55
serviceAccountType=filePath
66
serviceAccount=auto-detect

0 commit comments

Comments
 (0)