GDL

Data warehouse is a collective entity of data from various data sources. Data are prone to several complications and irregularities in data warehouse. Data cleaning service involves identification of errors, removing them and improve the quality of data. Data cleaning service is non trivial activity to ensure data quality. One of the common methods is duplicate elimination. This research focuses on the service of duplicate elimination on local data. It initially surveys data quality focusing on quality problems, cleaning methodology, involved stages and services within data warehouse environment. It also provides a comparison through some experiments on different duplicate elimination services based on different spelling on different pronunciation, misspellings, name abbreviation, honorific prefixes, common nicknames, splitted name and exact match. In addition, the comparison also includes the evaluation of performance for each service based on the required response time, memory load and CPU time, so that in the future these services are reliable to handle big data in data warehouse.

Beri Komentar ?#(0) | Bookmark