Configure Cleansing Rules
Cleansing rules define how records are filtered, excluded, or removed during the Cleansing stage.
Note: The following two cleansing rules should always be present.
First: Exclude Null or Empty PK - Null or Empty Primary Key
Last: Remove PK Duplicates - Forced Clean
Note: If you need to identify the appropriate duplicate primary key record to keep, you can use additional cleansing rules like Filter Old Duplicates; where you identify the date records to compare.
Add a new Cleansing rule
From the sidebar, select Assets.
In Data Manager, select Object classes.
Select the Show data sources button beside the Object class.
Select the data source you wish to cleanse.
Select Modify cleansing rules.
From Add cleansing rule:
Choose a rule from the dropdown, it will be added and expanded.
Configure rule parameters.
Select Save.
Note: If you don’t Save the rule will be removed.
Edit a Cleansing rule
From the sidebar, select Assets.
In Data Manager, select Object classes.
Select the Show data sources button beside the Object class.
Select the data source you wish to cleanse.
Select Modify cleansing rules.
In the Cleansing rules screen:
Use the expand/collapse icon to view rule details.
Edit the rule configuration.
Select Save.
Delete a Cleansing rule
From the sidebar, select Assets.
In Data Manager, select Object classes.
Select the Show data sources button beside the Object class.
Select the data source you wish to cleanse.
Select Modify cleansing rules.
In the Cleansing rules screen:
Use the expand/collapse icon to view rule details.
Select Remove function.
Select Save.
Change the order of Cleansing rules
Rule order matters: some rules should run before others.
From the sidebar, select Assets.
In Data Manager, select Object classes.
Select the Show data sources button beside the Object class.
Select the data source you wish to cleanse.
Select Modify cleansing rules.
In the Cleansing rules screen:
Use the six dots to select the rule and drag up or down
Select Save.
Was this helpful?