Astera Data Stack
Version 7
Version 7
  • Welcome to Astera Data Stack Documentation
  • Release Notes
    • Upgrading Astera 6 to Version 7
    • Release Notes for Astera 7.1
    • What is New in Astera 7.4
    • What’s New in Astera 7.4.1.221
    • What’s New in Astera 7.6
    • Upgrading to Astera 7.6
  • Setting Up
    • System Requirements
    • Installing Astera Data Integrator
    • Setting up Astera Integration Server 7
    • UI Walkthrough - Astera Data Integrator
  • Dataflows
    • Introducing Dataflows
    • Sources
      • Setting Up Sources
      • Raw Text Filters in File Sources
      • COBOL File Source
      • Database Table Source
      • Data Model Source
      • Delimited File Source
      • Email Source
      • Excel Workbook Source
      • File System Items Source
      • Fixed Length File Source
      • PDF Form Source
      • Report Source
      • SQL Query Source
      • XML/JSON File Source
    • Transformations
      • Aggregate Transformation
      • Apply To All Transformation
      • Constant Value Transformation
      • Data Cleanse Transformation
      • Data Quality Rules Transformation
      • Denormalize Transformation
      • Distinct Transformation
      • Expression Transformation
      • Filter Transformation
      • Function Transformations
      • Join Transformation
      • Merge Transformation
      • Normalize Transformation
      • Passthru Transformation
      • Rest Client
      • Route Transformation
      • Sequence Generator Transformation
      • Sort Transformation
      • Sources as Transformations
      • Subflow Transformation
      • Tree Join Transformation
      • Union Transformation
      • Web Service Transformation
    • Destinations
      • Setting Up Destinations
      • Database Table Destination
      • Delimited File Destination
      • Excel Workbook Destination
      • Fixed Length File Destination
      • SQL Statement Destination
      • XML/JSON File Destination
    • Data Logging and Profiling
      • Creating Data Profile
      • Creating Field Profile
      • Data Quality Mode
      • Record Level Log
      • Using Data Quality Rules in Astera
    • Database Write Strategies
      • Database Write Strategies
    • Text Processors
      • Fixed Length Parser
      • Fixed Length Serializer
  • Workflows
    • Adding Workflow Tasks
    • Creating Workflows
    • Using Workflow Designer
    • Customizing Workflows With Parameters
    • Workflows with a Dynamic Destination Path
    • Resuming and Rerunning Workflows in Astera
  • Subflows
    • Using Subflows
  • Functions
    • Functions Glossary
    • Introducing Function Transformations
    • Custom Functions
    • Logical
      • Coalesce (Any value1, Any value2)
      • IsNotNull (AnyValue)
      • IsRealNumber (AnyValue)
      • IsValidSqlDate (Date)
      • IsDate (AnyValue)
      • If (Boolean)
      • If (DateTime)
      • If (Double)
      • Exists
      • If (Int64)
      • If (String)
      • IsDate (str, strformat)
      • IsInteger (AnyValue)
      • IsNullOrWhitespace (StringValue)
      • IsNullorEmpty (StringValue)
      • IsNull (AnyValue)
      • IsNumeric (AnyValue)
    • Conversion
      • GetDateComponents (DateWithOffset)
      • ParseDate (Formats, Str)
      • GetDateComponents (Date)
      • HexToInteger (Any Value)
      • ToInteger (Any value)
      • ToDecimal (Any value)
      • ToReal (Any value)
      • ToDate (String dateStr)
      • TryParseDate (String, UnknownDate)
      • ToString (Any value)
      • ToString (DateValue)
      • ToString (Any data, String format)
    • Math
      • Abs (Double)
      • Abs (Decimal)
      • Ceiling (Real)
      • Ceiling(Decimal)
      • Floor (Decimal)
      • Floor (Real)
      • Max (Decimal)
      • Max (Date)
      • Min (Decimal)
      • Min (Date)
      • Max (Real)
      • Max (Integer)
      • Min (Real)
      • Pow (BaseExponent)
      • Min (Integer)
      • RandomReal (Int)
      • Round (Real)
      • Round (Real Integer)
      • Round (Decimal Integer)
      • Round (Decimal)
    • Financial
      • DDB
      • FV
      • IPmt
      • IPmt (FV)
      • Pmt
      • Pmt (FV)
      • PPmt
      • PPmt (FV)
      • PV (FV)
      • Rate
      • Rate (FV)
      • SLN
      • SYD
    • String
      • Center (String)
      • Chr (IntAscii)
      • Asc (String)
      • AddCDATAEnvelope
      • Concatenate (String)
      • ContainsAnyChar (String)
      • Contains (String)
      • Compact (String)
      • Find (Int64)
      • EndsWith (String)
      • FindIntStart (Int32)
      • Extract (String)
      • GetFindCount (Int64)
      • FindLast (Int64)
      • GetDigits (String)
      • GetLineFeed
      • Insert (String)
      • IsAlpha
      • GetToken
      • IndexOf
      • IsBlank
      • IsLower
      • IsUpper
      • IsSubstringOf
      • Length (String)
      • LeftOf (String)
      • Left (String)
      • IsValidName
      • Mid (String)
      • PadLeft
      • Mid (String Chars)
      • LSplit (String)
      • PadRight
      • ReplaceAllSpecialCharsWithSpace
      • RemoveChars (String str, StringCharsToRemove)
      • ReplaceLast
      • RightAlign
      • Reverse
      • Right (String)
      • RSplit (String)
      • SplitStringMultipleRecords
      • SplitStringMultipleRecords (2 Separators)
      • SplitString (3 separators)
      • SplitString
      • SplitStringMultipleRecords (3 Separators)
      • Trim
      • SubString (NoOfChars)
      • StripHtml
      • Trim (Start)
      • TrimExtraMiddleSpace
      • TrimEnd
      • PascalCaseWithSpace (String str)
      • Trim (String str)
      • ToLower(String str)
      • ToProper(String str)
      • ToUpper (String str)
      • Substring (String str, Integer startAt)
      • StartsWith (String str, String value)
      • RemoveAt (String str, Integer startAt, Integer noofChars)
      • Proper (String str)
      • Repeat (String str, Integer count)
      • ReplaceAll (String str, String lookFor, String replaceWith)
      • ReplaceFirst (String str, String lookFor, String replaceWith)
      • RightOf (String str, String lookFor)
      • RemoveChars (String str, String charsToRemove)
      • SplitString (String str, String separator1, String separator2)
    • Date Time
      • AddMinutes (DateTime)
      • AddDays (DateTimeOffset)
      • AddDays (DateTime)
      • AddHours (DateTime)
      • AddSeconds (DateTime)
      • AddMonths (DateTime)
      • AddMonths (DateTimeOffset)
      • AddMinutes (DateTimeOffset)
      • AddSeconds (DateTimeOffset)
      • AddYears (DateTimeOffset)
      • AddYears (DateTime)
      • Age (DateTime)
      • Age (DateTimeOffset)
      • CharToSeconds (Str)
      • DateDifferenceDays (DateTimeOffset)
      • DateDifferenceDays (DateTime)
      • DateDifferenceHours (DateTimeOffset)
      • DateDifferenceHours (DateTime)
      • DateDifferenceMonths (DateTimeOffset)
      • DateDifferenceMonths (DateTime)
      • DatePart (DateTimeOffset)
      • DatePart (DateTime)
      • DateDifferenceYears (DateTimeOffset)
      • DateDifferenceYears (DateTime)
      • Month (DateTime)
      • Month (DateTimeOffset)
      • Now
      • Quarter (DateTime)
      • Quarter (DateTimeOffset)
      • Second (DateTime)
      • Second (DateTimeOffset)
      • SecondsToChar (String)
      • TimeToInteger (DateTime)
      • TimeToInteger (DateTimeOffset)
      • ToDate Date (DateTime)
      • ToDate DateTime (DateTime)
      • ToDateString (DateTime)
      • ToDateTimeOffset-Date (DateTimeOffset)
      • ToDate DateTime (DateTimeOffset)
      • ToDateString (DateTimeOffset)
      • Today
      • ToLocal (DateTime)
      • ToJulianDate (DateTime)
      • ToJulianDayNumber (DateTime)
      • ToTicks (Date dateTime)
      • ToTicks (DateTimeWithOffset dateTime)
      • ToUnixEpoc (Date dateTime)
      • ToUtc (Date dateTime)
      • UnixTimeStampToDateTime (Real unixTimeStamp)
      • UtcNow ()
      • Week (Date dateTime)
      • Week (DateTimeWithOffset dateTime)
      • Year (Date dateTime)
      • Year (DateTimeWithOffset dateTime)
      • DateToJulian (Date dateTime, Integer length)
      • DateTimeOffsetUtcNow ()
      • DateTimeOffsetNow ()
      • Day (DateTimeWithOffset dateTime)
      • Day (Date dateTime)
      • DayOfWeekStr (DateTimeWithOffset dateTime)
      • DayOfWeek (DateTimeWithOffset dateTime)
      • DayOfWeek (Date dateTime)
      • DateToJulian (DateTimeWithOffset dateTime, Integer length)
      • DayOfWeekStr (Date dateTime)
      • FromJulianDate (Real julianDate)
      • DayOfYear (Date dateTime)
      • DaysInMonth(Integer year, Integer month)
      • DayOfYear (DateTimeWithOffset dateTime)
      • FromUnixEpoc
      • FromJulianDayNumber (Integer julianDayNumber)
      • FromTicksUtc(Integer ticks)
      • FromTicksLocal(Integer ticks)
      • Hour (Date dateTime)
      • Hour (DateTimeWithOffset dateTime)
      • Minute (Date dateTime)
      • JulianToDate (String julianDate)
      • Minute (DateTimeWithOffset dateTime)
      • DateToIntegerYYYYMMDD (DateTimeWithOffset dateTime)
      • DateToIntegerYYYYMMDD (Date dateTime)
    • Files
      • AppendTextToFile (String filePath, String text)
      • CopyFile (String sourceFilePath, String destFilePath, Boolean overWrite)
      • CreateDateTime (String filePath)
      • DeleteFile (String filePath)
      • DirectoryExists (String filePath)
      • FileExists (String filePath)
      • FileLength (String filePath)
      • FileLineCount (String filePath)
      • GetDirectory (String filePath)
      • GetEDIFileMetaData (String filePath)
      • GetExcelWorksheets (String excelFilePath)
      • GetFileExtension (String filePath)
      • GetFileInfo (String filePath)
      • GetFileName (String filePath)
      • GetFileNameWithoutExtension (String filePath)
      • LastUpdateDateTime (String filePath)
      • MoveFile (String filePath, String newDirectory)
      • ReadFileBytes (String filePath)
      • ReadFileFirstLine (String filePath)
      • ReadFileText (String filePath)
      • ReadFileText (String filePath, String codePage)
      • WriteBytesToFile (String filePath, ByteArray bytes)
      • WriteTextToFile (String filePath, String text)
    • Date Time With Offset
      • ToDateTimeOffsetFromDateTime (dateTime String)
      • ToUtc (DateTimeWithOffset)
      • ToDateTimeOffsetFromDateTime
      • ToDateTimeOffset (String dateTimeOffsetStr)
      • ToDateTimeFromDateTimeOffset
    • GUID
      • NewGuid
    • Encoding
      • ToBytes
      • FromBytes
      • UrlEncode
      • UrlDecode
    • Regular Expressions
      • ReplaceRegEx
      • ReplaceRegEx (Integer StartAt)
    • TimeSpan
      • Minutes
      • Hours
      • Days
      • Milliseconds
    • Matching
      • Soundex
      • DoubleMetaphone
      • RefinedSoundex
  • Report Model
    • User Guide
      • Report Model Tutorial
    • Report Model Interface
      • Field Properties
      • Pattern Properties
      • Region Properties
      • Report Browser
      • Report Options
    • Use Cases
      • Applying Pattern to Line
      • Auto-Creating Data Regions and Fields
      • Auto-Parsing
      • Creating Multi-Column Data Regions
      • Floating Patterns and Floating Fields
      • How to Work with Microsoft Word (Doc/Docx) Files in a Report Model
      • How to Work With OCR Scanned Files in a Report Model
      • How to Work With PDF Scaling Factor in a Report Model
      • Line Count
      • Pattern Count
      • Pattern is a Regular Expression
    • Exporting Options
      • Exporting a Report Model
      • Exporting Report Model to a Dataflow
    • Miscellaneous
      • Astera Report Model: Performance on Different Hardware Settings and Case Complexities
      • Microsoft Word and Rich Text Format Support
      • Importing Monarch Models
  • Project Management
    • Project Management
      • Deployment
      • Parameterization
    • Job Scheduler
      • Scheduling and Running Jobs on a Server
  • Web Services
    • Configuring Google Drive API through REST Client in Astera
    • Connecting to Eloqua using Astera REST API
    • POSTing Data Using the REST Client
    • Using the REST Client to Download a Text File
  • Metadata Management
    • Lineage and Impact Analysis
  • Connectors and Providers
    • Setting Up Oracle ODP.Net Connectivity in Astera
    • Running Microsoft Access Database Engine with Astera
    • Oracle Client Tools Setup
    • Oracle Data Load Options
  • Miscellaneous
    • Job Trace Improvements
    • SmartMatch Feature
    • Synonym Dictionary File
    • Using the Data Source Browser in Astera
  • Best Practices
    • Astera Best Practices - Dataflows
    • Cardinality Errors FAQs
    • Overview of Cardinality in Data Modeling
Powered by GitBook

© Copyright 2025, Astera Software

On this page
  • Decision
  • File System
  • File Transfer
  • Run Dataflow
  • Run Program
  • Run SQL File
  • Run SQL Script
  • Run Transfer
  • Run Transfer Batch
  • Run Workflow
  • Send Mail
  1. Workflows

Adding Workflow Tasks

PreviousFixed Length SerializerNextCreating Workflows

Last updated 9 months ago

Each task on the workflow is represented as a task object. You can have any number of tasks in your workflow, and your tasks can be linked in a sequence that controls the order in which the tasks are executed.

Decision

A Decision task invokes one of the two paths in the workflow, depending on whether the logical expression inside the Decision object returns a Yes (True) or a No (False) flag.

To use, drag and drop the Decision object onto the workflow designer. Configure the object by right-clicking on the object’s header and selecting Properties from the context menu.

This will open the Decision Properties window. This configuration screen provides the interface to create some decision logic.

In the Expression input box, enter an expression. This expression should return a Boolean result, such as True or False. An example of this expression is shown below. The expression here is based on the presence of erroneous records in a Run Dataflow task object.

Note: The right-hand pane displays the object tree (highlighted in yellow). You can double-click on an object to add it to your expression.

Click Compile to check for any syntax errors in your expression. The status should read “Successful” for a successful compilation.

File System

The File System Action task performs actions on a file or a folder, as it is configured. For example, this task can copy a file, move a file to another folder, or delete all files in a folder.

To use, drag and drop the File System Action object onto the workflow designer. Configure the object by right-clicking on the object’s header and selecting Properties from the context menu.

A File System Action Properties window opens as shown below. Here we configure the properties of the File System Action task.

Select an action from the Action dropdown list. The following options are available:

  • File Copy – copies a file from a source folder into a destination folder

  • File Move – moves a file from a source folder into a destination folder

  • File Rename – renames a file

  • File Delete – deletes a file

  • Directory Move – moves all files in the folder into a new folder

  • Directory Delete – deletes the folder along with any files or folders it contains

  • Directory Content Delete – deletes all files from the folder, leaving the folder empty (the folder itself is not deleted).

  • Source File (Directory) Path – specifies the path to the source file or source directory

  • Destination Directory Path – specifies the path to the destination file or destination folder

File Transfer

The File Transfer task performs the specified actions on an FTP server. For example, the task can upload a file to an FTP server, rename a file, or delete all files from a remote directory.

To use, drag and drop the File Transfer task object onto the workflow designer. Configure the object by right-clicking on the object’s header and selecting Properties from the context menu.

A File Transfer Action Properties window opens as shown below. Here, we configure the properties of the File Transfer task.

FTP Connection – To configure the connection with your FTP server, click on the ellipsis. A Web Connection window opens up.

Here, set up the FTP server connection by providing the URL, Login Name, and Password. In case of using a proxy, fill in the details under Proxy Info. For security protocols, provide details under FTPS Security Settings.

FTP Action – select an action from the FTP Action dropdown. The following options are available:

  • Upload a File – uploads a file from a local folder into the remote directory

  • Download a File – downloads a file from the remote directory into a local folder

  • Delete a File – deletes file from the remote directory

  • Rename – renames a file in the remote directory

  • Remove Directory – deletes the remote directory

  • Upload a File with Unique Name– uploads a file from a local folder into the remote directory, renaming the file if needed to ensure a unique file name in the remote directory.

  • Remote Info-Path – specify the path of a file or folder on the FTP server.

  • Local Info-Path– specify the local path on the server running the workflow.

Run Dataflow

The Run Dataflow task is used to execute a dataflow as part of a workflow. Multiple Run Dataflow task objects can be employed as part of a workflow, to orchestrate a data process.

To use, drag and drop the Run Dataflow task object onto the workflow designer. Configure the object by right-clicking on the object’s header and selecting Properties from the context menu.

A Start Dataflow Job Properties window opens as shown below:

  • Job Info-Path – specify the path to the dataflow that you want to run.

Note: To ensure that your workflow is runnable on a remote server, please avoid using local paths for the dataflow. Using UNC paths is recommended.

  • Run in Pushdown mode – executes a dataflow on the server without fetching data to the Astera client.

Run Program

The Run Program task is used to run an executable command or batch file, as part of your workflow. Tasks, such as a series of commands in another programming language (e.g. Python/R) in the form of a .bat extension file, are executed through the Run Program task object.

To use, drag and drop the Run Program task object onto the workflow designer. Configure the object by right-clicking on the object’s header and selecting Properties from the context menu.

A Run Program Properties window opens as shown below. This screen lets users define properties for an executable batch file.

  • Program Path – specify the file path to the executable batch file that you want to run as part of the workflow.

  • Run In – specify the default folder where Astera will run the batch file. (optional)

  • Arguments – specify any required or optional arguments for running the batch file, such as providing an external input or indicating an input parameter change.

  • Run As – enter a user account (if different from the administrator) that should be used for running the batch file.

  • Password – enter the password specific to the user account entered in the Run As option.

  • Success Value – a value returned by the executable batch file upon its successful completion. The default value is 0. The Run Program task will expect this value to signal the successful completion of the task.

  • Timeout – define a time after which, if the program task fails to execute, Astera will terminate the process.

  • Fail Action if Unsuccessful – select this option to return an error when the executable batch file ends with an error in the code.

  • Wait for Task to Complete – select this option to stop Astera from proceeding to the next task in the workflow until the batch file has finished running.

Run SQL File

The Run SQL File task runs the SQL code inside a file of .sql extension as part of a workflow.

To use, drag and drop the Run SQL File task object onto the workflow designer. Configure the object by right-clicking on the object’s header and selecting Properties from the context menu.

A Database Connection window opens as shown below. This is where we configure the connection with the database.

Astera offers native connectivity to a number of databases and applications. To connect to a database, click on the drop-down menu next to the Data Provider option and select a data provider from the list.

To establish a connection to a data provider, fill in the credentials such as User Id, Password, Server Name, Database, and Schema.

The next screen is the Run Sql File Properties window.

SQL File Path – specify the path to the SQL file that you want to execute through this task.

The next screen is the Config Parameters screen. This is where users can set up variable parameters to indicate a run-time change for values in the list on the screen.

Run SQL Script

The Run SQL Script task provides flexibility to write SQL code within Astera and deploy it as part of a workflow.

To use, drag and drop the Run SQL Script task object onto the workflow designer. Configure the object by right-clicking on the object’s header and selecting Properties from the context menu.

A Database Connection window opens as shown below. This is where we configure the connection with the database.

The connection to a data provider is established similar to how it is described for the Run SQL File task object.

The next is the Run Sql Properties screen. In the SQL Statement box, enter the SQL code. This code will be executed by the Run SQL Script task.

Run Transfer

The Run Transfer task executes a transfer setting as part of your workflow.

To add a Run Transfer task, drag the Run Transfer object from the Workflow Tasks group in the Flow toolbox and drop it on the workflow.

An example of what a Run Transfer object might look like is shown below:

To configure the properties of a Run Transfer object after it was added to the workflow, right-click on it and select Properties from the context menu. The following properties are available:

  • Start Transfer Job Properties screen:

    • Job Info: Path – specify the path to the transfer setting that this task will execute.

Note: To ensure that your workflow is runnable on a remote server, please avoid using local paths for the transfer setting. Using UNC paths is recommended.

  • Run At: select the server that should execute the transfer setting

  • General Options screen: The Comments input allows you to enter comments associated with this object.

Run Transfer Batch

The Run Transfer Batch task executes a transfer batch as part of your workflow.

To add a Run Transfer Batch task, drag the Run Transfer Batch object from the Workflow Tasks group in the Flow toolbox and drop it on the workflow.

An example of what a Run Transfer Batch object might look like is shown below.

To configure the properties of a Run Transfer Batch object after it was added to the workflow, right-click on it and select Properties from the context menu. The following properties are available:

  • Start Batch Job Properties screen:

  • Job Info: Path – specify the path to the transfer batch that this task will execute.

Note: To ensure that your workflow is runnable on a remote server, please avoid using local paths for the transfer batch. Using UNC paths is recommended.

  • Run At: select the server that should execute the transfer batch

  • General Options screen: The Comments input allows you to enter comments associated with this object.

Run Workflow

The Run Workflow task starts another workflow as part of a nested workflow. The object works similarly to the Run Dataflow task:

To use, drag and drop the Run Workflow task object onto the workflow designer. Configure the object by right-clicking on the object’s header and selecting Properties from the context menu.

A Start Workflow Job Properties window opens as shown below:

  • Job Info-Path – specify the path to the workflow you want to run.

Note: To ensure that your workflow is runnable on a remote server, please avoid using local paths for the workflow executed by this task. Using UNC paths is recommended.

  • Run At: select the server that should run the workflow

  • Parameter Information Replacement screen provides the interface to modify connection parameters as required by your target environment.

  • General Options screen: The Comments input allows you to enter comments associated with this object.

Send Mail

The Send Mail task sends emails to the administrator at appropriate junctions in a workflow.

To use, drag and drop the Send Mail task object onto the workflow designer. Configure the object by right-clicking on the object’s header and selecting Properties from the context menu.

A Send Mail Properties window opens up as shown below:

  • Server – specify the server setting for an email platform by clicking on the ellipsis.

An Email Connection window opens up. This is where we specify the server connection details.

  • Recent – select from the dropdown list of recent server configurations to automatically populate your connection info.

Options under Connection Info depend on the email provider the user wants to employ.

Test your connection with the email provider by clicking on the Test Connection button. A Send Test Email window opens up that lets users send a test mail to the intended recipient.

Once the connection with the email provider has been set up, go back to the Send Mail Properties window to fill in the necessary details.

  • From – enter the sender's email account

  • To – enter the recipients of the email

  • Subject – enter the subject line for the email

  • CC – specify any CC recipients

  • BCC – specify any BCC recipients

  • Attachment – Provide any attachments that should be sent with the email

  • Message – Enter the body of the email that will be sent by this task

This concludes the description of the various workflow tasks in Astera.

Note: The Run Transfer task is in place for compatibility with previous versions of Astera. In the current version of Astera, dataflows replace transfer settings and provide superior functionality, so you should use the task instead.

Note: The Run Transfer Batch task is in place for compatibility with previous versions of Astera. In the current version of Astera, dataflows replace transfer batches and provide superior functionality, so you should use the task instead.

Note: For more information on server settings for different email providers, click .

Run Dataflow
Run Dataflow
here