The Data Transformation module offers different ways of performing transformations on your data. These include transformation steps that can be dragged into a flow, performing inline field transformations, and even data conversion. Besides the transformation steps that come included with this module, you can also download and install plug-ins to include more steps in your environment.
Here is a breakdown of the different ways of performing transformations:
- Built-in transformations: This refers to transformations in the transformation step panel that come included in the data transformation module. These do not require any type of set up.
- Downloadable transformation step: You can also download and install special plug-ins from the Marketplace that become available in the transformation step panel. (See the Transform Steps section in the Marketplace for all available options.)
- Inline field transformations: This refers to functions that users can perform directly on the data (in the data preview panel or the step configuration panel).
Following is a list of all the transformations that you can perform on your data. Click on a transformation name to learn how to use it in your flow.
Transformation | Type | Description |
|---|---|---|
| Built-in transformation step | This step transforms your data into a summary form, by applying functions like count, count distinct, sum, average, etc. | |
| Built-in transformation step | This step creates a calculated field based on other fields in the step. | |
| Built-in transformation step | This step is for filtering data in a step. | |
| Built-in transformation step | This step merges two sets of data based on the configured Join Fields. | |
| Built-in transformation step | This step duplicates an input dataset to create identical output datasets. | |
| PMML Model Prediction | Downloadable transformation step | This step integrates a model saved as a PMML file into the platform and applies it on the data. |
| PFA Model Prediction | Downloadable transformation step | This step integrates a PFA model and applies it on the data. |
| H2O Model Prediction | Downloadable transformation step | This step integrates a model created in H2O.ai and applies it on the data. |
| R Model Prediction | Downloadable transformation step | This step integrates an R model and applies it on the data. |
| Data Type Conversions | Inline Field transformation | This function is used to convert the datatype of a field into another type. For example, text can be converted into numeric values, SQL date, or SQL timestamp. |
| Duplicate Field | Inline Field transformation | To create a copy of the data field. |
| Number Precision | Inline Field transformation | To round off a numeric value. |
| Sub-string | Inline Field transformation | To extract part of a string. |
| Switch Case | Inline Field transformation | To convert text to all uppercase, all lowercase, or proper case. |
| White Space | Inline Field transformation | To remove white space from data. |