Join Transformation

The Join transformation object joins records from two record sets. The join functionality is similar to standard SQL joins, but the distinguishing advantage of Astera's implementation is that you can join records from any two sources and not just two database tables.

This article covers how you can use Join transformation in Astera.

Sample Use Case

Suppose we have two database tables - Customers and Orders, as shown in the screenshot below, and we want to join these two tables.

Working with the Join Transformation Object

Let’s see how we can join the two tables using the Join transformation object in Astera:

1. Drag and drop the Join transformation object from the Transformations section in the Toolbox. To open the Toolbox, go to View > Toolbox.

1. Map the fields from the source objects to the Join transformation object.

Note: To quickly add fields to the layout, drag and drop the bold node’s output port of the object whose layout you wish to replicate to the bold Join node of the Join object.

1. To set the properties for the Join transformation, double-click on the object or right-click and select Properties.

1. The first window is the Layout Builder window. You can manage the layout for your transformation (add or remove fields) from this window. Click Next to go to the next window.

1. The next window is the Relation Join Transformation Properties window. Select the Join Type from the drop-down menu. Astera supports four types of joins:

   • Inner Join – Joins records from two record sets based on matching values in key fields. Any unmatched records are discarded.

   • Left Outer Join – Similar to Inner Join, however, unmatched records from the left record set (also called ‘first record set’) are preserved, and null values are written for the unmatched record in the right record set (also called ‘second record set’).

   • Right Outer Join – Similar to Inner Join, however, unmatched records from the right record set (also called ‘second record set’) are preserved, and null values are written for the unmatched record in the left record set (also called ‘first record set’).

   • Full Outer Join - similar to Inner Join, however, unmatched records from either record set are preserved, and null values are written for the unmatched record in the other record set.

1. Other options in this window:

   • Join in Database: Check this option if you want to join the tables in the database.

   • Case Sensitivity: Check this option if you want a case-sensitive match of the values in the key fields.

   • Sort (Left/Right) Input: Specify whether the left input, the right input, or both, need to be sorted.

2. Select the key fields from the Left Field and Right Field drop-down lists. Click Next, then OK.

Note: You can add multiple fields to create a composite key field.

1. You can now preview the output and see the consolidated data.

General Options Window

This window consists of options common to most objects in a dataflow:

• General Options Window: This window shares options common to most objects in the dataflow.

• Clear Incoming Record Messages: When this option is checked, any messages coming in from objects preceding the current object will be cleared. This is useful when you need to capture record messages in the log generated by the current object and filter out any record messages generated earlier in the dataflow.

• Do Not Process Records with Errors: When this option is checked, records with errors will not be output by the object. When this option is off, records with errors will be output by the object, and a record message will be attached to the record. This record message can then be fed into downstream objects in the dataflow, for example, a destination file that will capture record messages or a log that will capture messages and collect statistics as well.

• The Comments input allows you to enter comments associated with this object.