Dynamic Query Builder Using Meta Data
Ever wondering how easy and user friendly it is to build dynamic query using excel. I have created a excel template to define Join , where and Column configuration , and it will produce the select query automatically.
It can be a really handy tool for an extract stage of ETL and Data is extracted from Source and Staged in a staging Area. If you are working with SSIS then you don't have to create individual DFT for each table to be extracted.. A single DFT will meta Data Configuration can do this complex job.
Next stage of ETL is Transformation, which includes validations of business rules as per Target meta data and transforming the data in desired format.
I am extending the framework where dynamic queries can be build from sources as per defined target and business rules can be configured, to perform the job in desired way.
It stores the error and rejections in a separate area.
Then Finally loading stage, which is single ETL as per defined target.
Ideally your jobs is capture requirements and configure it in the meta data defined structure... to have quick readiness of these ETL..
If you need these templates, feel free to drop me an email at techbiCenter@gmail.com
0 comments:
Post a Comment