Data Profiler for data quality assessment


assesses data quality, quantity, composition, anomalies, similarities, and patterns. It is instrumental in the data discovery phase in understanding the facets of data and for data curation (i.e., data-prep) for ingestion. For example; 'part' is defined as a semantic concept which is represented by multiple objects/relationships in different systems. eQube-DP can identify commonalties, correlations, and differences ('quality') for 'part' irrespective of its data structure in those systems. Such qualification of data then can be used not only to correct and repair the data, but also as an essential step in establishing transformation rules for application migration and integration. DP leverages ADA and BI capabilities to deliver an integrated solution for data profiling and data curation.

eQube-DP Use Cases:


eQube-DP can be used to address the following use cases:

  • Legacy data clean up pre-migration
  • To de risk Migration and Integration projects by driving the requirements, configuration of the target system and business decisions required for successful deployment
  • Automatically Repair Data and provide real time data quality health monitoring
  • To compare multiple data sources, BOM's, attributes and data directly via standard connectors on a real time or scheduled basis
  • Data quality trend analysis
  • Master Data Management to control, track and audit changes to data sets and provide capability to merge data sets


Automated Data Repair & Health Monitoring Process


Using eQube-DP, a solution can be built that can assess the data quality, facilitate automatic data repair, and continuously monitor the health of data quality. The steps are as follows:

  • Aggregate & analyze multiple data sets by applying validation rules
  • Report on data issues, anomalies found or data set comparisons(eQube-BI)
  • Make changes in-memory with automated business approval process to undertake repairs
  • Once approvals are in place, update source systems based upon defined business logic and rules (using the business process modeling capability in eQube-MI)

The following figure depicts the concept.

Automated Data Repair & Health Monitoring flow using eQube Platform

Our solutions