Page History

Overview

This step merges two sets of data based on the configured Join Fields. 

Types of Join

The table below explains the types of Joins that can be applied using this step.

Join Type	Explanation	Diagram
Inner Join	Returns records that have matching values in both tables.	Image Added
Left Outer Join	Return all records from the left table, and the matched records from the right table.	Image Added
Right Outer Join	Return all records from the right table, and the matched records from the left table.	Image Added

Step Configuration

Follow the instructions below to configure a merge step:

1. Ensure that your flow already has two different steps that need to be merged.
2. Expand the Transformation Steps button on the left side of the Transformation Flow builder, to view a list of transformation steps.
3. Drag the Merge step from this list.
   
   Image Added
   
   
4. Connect the two input steps with the merge step one by one.
5. Configure the merge step details in the step configuration panel:
   
   Image Added
   
   

   1. Select a join type. (See the chart above for a description of each of the Join types.)

      
      Image Added

      Note
      In case no join type is selected, the system will invoke a Cross Join. This joins each row on the left with every row on the right, and hence isn't an ideal option. However, it can be applied to generate test data.

      
      
      

   2. Join each field to its counterpart to merge them together.
   3. Click on the Add Join button to include a new join field in the panel.
      
      Image Added
      
      
   4. Repeat these steps for any fields that are to be joined.
   5. You can delete a join field by clicking on its delete icon if required. 
      
      Image Added
      
      
   6. Once done, click Apply. The values will appear in the data preview panel.

6. The system will colour-code fields from the different steps to help differentiate between them.
   
   Image Added
   
   
   

Complete Example

The following example shows a full transformation flow that involves a merge step. Our example will merge data extracted In this example, we will cover how to create a simple transformation flow that merges data from a database table and a report by joining a common field. Therefore, this transformation will involve setting up (using two separate input steps (one for each of the data source), combining then combine them by using the merge transformation step, and then storing the merged data finally store the result into a database. You could always include additional steps in your own transformation flow. 

...