The Filter transform filters out rows that do not meet the configured criteria/settings. For example, use this transform when all of the data being read from a data source is not required and the data source doesn’t allow querying (e.g., XML).
The following are some of the filter operators available in a Filter transform:
- Does Not Equal
- Less Than
- Less Than Or Equal
- Greater Than
- Greater Than Or Equal
- Not Equals Value Or Is Null
Numeric columns have additional options, such as:
- Contains Any
- Is A Number
- Is Not A Number
- Is A Number
String columns have further additional options:
- Does Not Contain
- Starts With
- Ends With
- Equals Any
- Contains All
- Contains None
- Matches Regular Expression
- Does Not Match Regular Expression
The Filter transform requires one input transform that has at least one column.
Uncheck any column(s) you don't want to be included in the output. These can still be used to filter the records.
Click the Edit icon for a column to filter by its values.
In the Transform Element dialog, select the Element Operator.
Operators compare against one or more values. Fill in the fields that follow (e.g., Value).
Click the submit button at the bottom of the dialog. The icon will now indicate its filtering with a distinct icon.
When filtering by more than one column's values, use the Operator setting in the Filter dialog to determine whether all of the conditions must be met (And Operator) or any of the conditions must be met (Or Operator) for records to be included.
The figure below illustrates the output for our example. Only rows with OrderQty greater than 5000 are included.