Skip to content

Commit 0cdf59d

Browse files
author
AWS
committed
AWS Glue Update: AWS Glue Crawlers can now accept SerDe overrides from a custom csv classifier. The two SerDe options are LazySimpleSerDe and OpenCSVSerDe. In case, the user wants crawler to do the selection, "None" can be selected for this purpose.
1 parent 3677ba4 commit 0cdf59d

File tree

2 files changed

+26
-0
lines changed

2 files changed

+26
-0
lines changed
Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
{
2+
"type": "feature",
3+
"category": "AWS Glue",
4+
"contributor": "",
5+
"description": "AWS Glue Crawlers can now accept SerDe overrides from a custom csv classifier. The two SerDe options are LazySimpleSerDe and OpenCSVSerDe. In case, the user wants crawler to do the selection, \"None\" can be selected for this purpose."
6+
}

services/glue/src/main/resources/codegen-resources/service-2.json

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6562,6 +6562,10 @@
65626562
"CustomDatatypes":{
65636563
"shape":"CustomDatatypes",
65646564
"documentation":"<p>Creates a list of supported custom datatypes.</p>"
6565+
},
6566+
"Serde":{
6567+
"shape":"CsvSerdeOption",
6568+
"documentation":"<p>Sets the SerDe for processing CSV in the classifier, which will be applied in the Data Catalog. Valid values are <code>OpenCSVSerDe</code>, <code>LazySimpleSerDe</code>, and <code>None</code>. You can specify the <code>None</code> value when you want the crawler to do the detection.</p>"
65656569
}
65666570
},
65676571
"documentation":"<p>Specifies a custom CSV classifier for <code>CreateClassifier</code> to create.</p>"
@@ -7613,6 +7617,10 @@
76137617
"CustomDatatypes":{
76147618
"shape":"CustomDatatypes",
76157619
"documentation":"<p>A list of custom datatypes including \"BINARY\", \"BOOLEAN\", \"DATE\", \"DECIMAL\", \"DOUBLE\", \"FLOAT\", \"INT\", \"LONG\", \"SHORT\", \"STRING\", \"TIMESTAMP\".</p>"
7620+
},
7621+
"Serde":{
7622+
"shape":"CsvSerdeOption",
7623+
"documentation":"<p>Sets the SerDe for processing CSV in the classifier, which will be applied in the Data Catalog. Valid values are <code>OpenCSVSerDe</code>, <code>LazySimpleSerDe</code>, and <code>None</code>. You can specify the <code>None</code> value when you want the crawler to do the detection.</p>"
76167624
}
76177625
},
76187626
"documentation":"<p>A classifier for custom <code>CSV</code> content.</p>"
@@ -7641,6 +7649,14 @@
76417649
"min":1,
76427650
"pattern":"[^\\r\\n]"
76437651
},
7652+
"CsvSerdeOption":{
7653+
"type":"string",
7654+
"enum":[
7655+
"OpenCSVSerDe",
7656+
"LazySimpleSerDe",
7657+
"None"
7658+
]
7659+
},
76447660
"CustomCode":{
76457661
"type":"structure",
76467662
"required":[
@@ -20074,6 +20090,10 @@
2007420090
"CustomDatatypes":{
2007520091
"shape":"CustomDatatypes",
2007620092
"documentation":"<p>Specifies a list of supported custom datatypes.</p>"
20093+
},
20094+
"Serde":{
20095+
"shape":"CsvSerdeOption",
20096+
"documentation":"<p>Sets the SerDe for processing CSV in the classifier, which will be applied in the Data Catalog. Valid values are <code>OpenCSVSerDe</code>, <code>LazySimpleSerDe</code>, and <code>None</code>. You can specify the <code>None</code> value when you want the crawler to do the detection.</p>"
2007720097
}
2007820098
},
2007920099
"documentation":"<p>Specifies a custom CSV classifier to be updated.</p>"

0 commit comments

Comments
 (0)