ETL Process , a common terminology used in dataware , datamart projects.It stand for Extraction, Transforming and loading process.
 |
| ETL Process |
Lets discuss the various stages of ETL process.
Extract:
This is the first part ETL process ,which is responsible for extracting the source input data.This is an important phase , as following process depend on this.Commonly use data source are database tables, simple flat files. xml files.This process involves the parsing of data., so it will validate the data before giving it for further processing.
Transformation:
This process involves processing of raw data. It may include data conversion , transposing of data, calculation of data. It may include the ref data populated based on lookup tables.All complex calculations are done in this part.
Loading:
Loading includes the population of processed data into target system. Target system includes tables, files, other system like SAP.We need to take care of performance here , as this may include constraint validation in case of database target system.
ETL Tools:Various ETL tools available in Market are Informatica, Oracle Data Integerator .
For More details on ETL process you can visit “ETL Process understanding“
For More details on Informatica , you can visit “What is Informatica“
This is the first part ETL process ,which is responsible for extracting the source input data.This is an important phase , as following process depend on this.Commonly use data source are database tables, simple flat files. xml files.This process involves the parsing of data., so it will validate the data before giving it for further processing.
Transformation:
This process involves processing of raw data. It may include data conversion , transposing of data, calculation of data. It may include the ref data populated based on lookup tables.All complex calculations are done in this part.
Loading:
Loading includes the population of processed data into target system. Target system includes tables, files, other system like SAP.We need to take care of performance here , as this may include constraint validation in case of database target system.
ETL Tools:Various ETL tools available in Market are Informatica, Oracle Data Integerator .
For More details on ETL process you can visit “ETL Process understanding“
For More details on Informatica , you can visit “What is Informatica“
