Data Manager - Cleansing statistics

The Cleansing statistics screen contains detailed information on records that were cleansed and imported during the Cleanse and Import operations.

For each cleansing rule included on a data source, users are able to view the records from the data source that meet the criteria of the cleansing rule, and are therefore excluded from the final set of object.

The cleansing statistics screen includes the following columns (from left to right):

• Object - the name of the destination object class.

• Data source - the name of the data source that was cleansed and/or imported.

The next four columns contain total numbers of objects:

• Uploaded - number of records received from the data source.

• Importable - is the number of records that remain in Data Manager after excluding and filtering.

• Filtered - the total number of records that were filtered. Filtered records are records that are filtered out of Data Manager due to a filter function, but are visible in Cleansed Data. Within the Cleansed Data you will be able to see the reason for it being filtered.

• Excluded - the total number of objects that were not loaded into Data Manager due to an exclude rule. The exclude rules are the two default cleansing rules - Exclude old or null primary keys and Remove primary key duplicates. These two exclude cleansing rules are required on all data sources.
  For example: The number of records that appear in the Forced Clean column have been excluded from the golden dataset as the Primary Key is a duplicate. Clicking on the blue numbers will link you through to the list of those records to review.

The remaining columns break down the total number of objects Filtered and Excluded through rules.

The header of each column is the Reason that these objects were Filtered or Excluded. These reasons, in turn, break down into the specific cleansing rules.