Skip to content

passthroughTR

datacorner edited this page Dec 1, 2023 · 4 revisions

passthroughTR Transformer

Purpose

This transformer does ... nothing. However it couls be used when it's needed to change the Dataset name (id) or when no transformation is needed between one or several extraction and one or more loadings.

It works in a very simple way:

  • It accepts many datasets in input.
  • If one dataset is specified in input it must have a corresponding (same order) dataset in output. Said differently the configuration must have the same number of dataset in input and in output.

Configuration by using the SQL directly in the configuration file

The specific configuration (as a Datasource) in the configuration file section parameters inclues the following parameters:

  • inputs: List of dataset ids in an array
  • outputs : List of dataset ids in an array

Configuration example:

    "transformers":  [
    { 
        "id": "T1",
        "classname": "pipelite.transformers.passthroughTR",
        "inputs" : [ "S1", "S2" ],
        "outputs" : [ "O1", "O2" ]
    }
    ... ] ...

🏠 Home
πŸ”‘ Main concepts
πŸ’» Installation
πŸ”¨ Configuration
πŸš€ Running

Supported Data Sources
πŸ“„ CSV File
πŸ“‘ XES File
πŸ“ƒ Excel File
πŸ“€ ODBC
🏒 SAP
🎒 ABBYY Timeline

Supported Transformations
πŸ”€ Pass Through
πŸ“Ά Dataset Profiling
πŸ”‚ Concat 2 Data sources
πŸ†– SubString
πŸ†’ Column Transformation
πŸ”ƒ Join data sources
πŸ”ƒ Lookup
πŸ”€ Rename Column Name

Extending pipelite
βœ… how to
βœ… Adding new Data sources
βœ… Adding new Transformers
βœ… Adding new Pipelines

Clone this wiki locally