34 Subsystems of ETL
In this, and in the next series of posts, I will be exploring the 34 subsystems of ETL Data Integration as defined by the Kimball Group. I introduce the subsystems in this post, and then I will discuss how each fits (or does not fit) into Talend & PDI . The subsystem concept is a best-practice initiative formulated by The Kimball Group to help organizations design effective and efficient Data Integration environments for Data Warehousing using the Dimensional Model. The Kimball Group categorizes the subsystems into 4 distinct groups: Data Extraction, Cleansing and Conforming Tasks, Data Delivery, and Management. Data Extraction 1. Data Profiling Talend: Talend has a separate tool for data profiling & data quality called 'Talend Open Studio for Data Quality' Pentaho: 'DataCleaner' plugin is available for download for this purpose 2. Change Data Capture (CDC) Talend: Talend has a inbuilt trigger based CDC feaature which can be applied easily. (En
