Saturday, April 3, 2010

Data Quality Approach ...

What should be the Data Quality approach  ??? ... Sharing few points ... which I have implemented in my current project ...


  • Source systems should be throughly analyzed and profiling should be done on parameters like completeness, conformance, consistency, accuracy and integrity.  Various tools can be used to achieve this ... like Informatica Data Explorer and Data Quality, OWB Profiling and Quality options (DWR), Business objects Data Insight and many more ...

  • Next is to identify key business columns for which data rules needs to be derived and apply them during data quality standardizing and cleansing process ...


  • After identifying key business columns, derive data quality rules for those columns and discuss with the client to finalize the data rules and to move next level of quality process ...


  • Now create Data Quality Plans based on rules dervied to address the four dimensions of Data Quality namely Completeness, Conformity, Integrity and Consistency

  • Implement and test the data quality plans before moving the data to target systems ...