You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+7-6Lines changed: 7 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,22 +1,23 @@
1
-
# Generation Metadata Interface for Data Warehouse Automation
1
+
# Generation Metadata Schema for Data Warehouse Automation
2
2
3
3
#### Intent
4
4
5
-
To provide a collaborative space to discuss an exchange format concerning ETL generation metadata, supporting Data Warehouse Automation. This adapter should contain all metadata necessary to generate ETL.
5
+
To provide a collaborative space to discuss an exchange format concerning ETL generation metadata, supporting Data Warehouse Automation. This adapter should contain all metadata necessary to generate the transformation logic for a Data Warehouse solution.
6
6
7
7
#### Links / structure
8
8
9
9
The following directories have been set up:
10
10
11
11
* Generic interface, containing the Json schema definition.
12
-
* Class Library containing the object model for deserialisation, as well as various utility classes such as validation of files against the Json schema definition.
13
-
* Code examples, containing C# examples using the generic interface for various purposes.
12
+
* Class Library (DataWarehouseAutomation) containing the object model for deserialisation, as well as various utility classes such as validation of files against the Json schema definition.
13
+
* Code examples (examples_handlebars), containing C# examples using the generic interface for various purposes.
14
+
* Regression test project (test_project)
14
15
15
16
#### Hypothesis
16
17
17
18
Across most, if not all, metadata models there is a core set of information that is required for any generation of ETL. If we can separate this from the UI / management of metadata we could have an exchange format that allows anyone to 'plug in' their own desired technology.
18
19
19
-
As an example '[TEAM](https://github.com/RoelantVos/TEAM)' has the intent to separate UI with a view of limiting data entry and validation, but does not focus on SQL generation. Rather, these functions are separated by an adapter that is accessible as JSON or database view.
20
+
As an example '[TEAM](https://github.com/RoelantVos/TEAM)' has the intent to separate UI with a view of limiting data entry and validation, but does not focus on SQL generation. Rather, these functions are separated by an adapter that is accessible as Json or database view.
20
21
21
22
#### Requirements
22
23
@@ -36,7 +37,7 @@ Some of these are built inside existing tools (i.e. ERwin, Powerdesigner) using
36
37
37
38
This is in addition to the many off-the-shelf DWA platforms, each of which has their own repository and format as well.
38
39
39
-
In a broader meritocracy sense it is worth pursuing if a common exchange format for metadata can be defined in a way that any developer can develop to in whatever technology or way their passion drives them.
40
+
In the broader sense of meritocracy, it is worth pursuing if a common exchange format for metadata can be defined in a way that any developer can develop to in whatever technology or way their passion drives them.
0 commit comments