Cleansing statistics

The Cleansing statistics screen contains detailed information on records that were cleansed and merged during the cleanse and merge operations.

For each cleansing rule included on a data source, you can view the records from the data source that meet the criteria of the cleansing rule, and are therefore excluded from the final set of objects.

The Cleansing statistics screen includes the following columns (from left to right):

• Data source – the name of the data source that was cleansed and/or imported.

The next four columns contain total numbers of objects:

• Uploaded – number of records received from the data source.

• Importable – the number of records that remain in Data Manager after excluding and filtering.

• Filtered – the total number of records that were filtered. Filtered records are records that are filtered out of Data Manager due to a filter cleansing rule, but are visible in Cleansed data. Within Cleansed data you can see the reason for each record being filtered.

• Excluded – the total number of objects that were not loaded into Data Manager due to an exclude rule. The exclude rules are the two default cleansing rules – Exclude old or null primary keys and Remove primary key duplicates. These two exclude cleansing rules are required on all data sources.

For example: the number of records that appear in the Forced Clean column have been excluded from the golden dataset because the primary key is a duplicate. Selecting the blue numbers links you through to the list of those records to review.

The remaining columns break down the total number of objects Filtered and Excluded through rules.

The header of each column is the Reason that these objects were filtered or excluded. These reasons, in turn, break down into the specific cleansing rules.