Page History
The data transformation module is used to perform various types of transformations on data. These can be done via transformation steps or by carrying out functions directly on the data. Here is a breakdown of the different ways of performing transformations:
- Built-in transformations: This refers to transformations in the transformation step panel that come included in the data transformation module.
- Downloadable transformation step: Users can also download and install special plug-ins from the Marketplace that become available in the transformation step panel.
- Field transformations: This refers to functions that users can perform directly on the data (in the data preview panel or the step configuration panel).
Following is a list of all the transformations that you can perform on your data. Click on a transformation name to learn how to use it in your flow.
Transformation | Type | Description |
|---|---|---|
| Built-in transformation step | This step transforms your data into a summary form, by applying functions like count, count distinct, sum, average, etc. | |
| Built-in transformation step | This step creates a calculated field based on other fields in the step. | |
| Built-in transformation step | This step is for filtering data in a step. | |
| Built-in transformation step | This step merges two sets of data based on the configured Join Fields. | |
| Built-in transformation step | This step duplicates an input dataset to create identical output datasets. | |
| PMML Model Prediction | Downloadable transformation step | This step integrates a model saved as a PMML file into the platform and applies it on the data. |
| PFA Model Prediction | Downloadable transformation step | This step integrates a PFA model and applies it on the data. |
| H2O Model Prediction | Downloadable transformation step | This step integrates a model created in H2O.ai and applies it on the data. |
| R Model Prediction | Downloadable transformation step | This step integrates an R model and applies it on the data. |
| Datatype Conversions | Field transformation | This function is used to convert the datatype of a field into another type. For example, text can be converted into numeric values, SQL date, or SQL timestamp. |
| Duplicate Field | Field transformation | To create a copy of the data field. |
| Number Precision | Field transformation | To round off a numeric value. |
| Sub-string | Field transformation | To extract part of a string. |
| Switch Case | Field transformation | To convert text to all uppercase, all lowercase, or proper case. |
| White Space | Field transformation | To remove white space from data. |