Description

You will lead the design, development, and deployment of complex ETL and data pipeline solutions within a Data Lakehouse architecture.

Responsibilities

• Design, develop, and test ETL/data pipelines and metadata-based frameworks.
• Analyze source systems, profile data, and resolve data quality issues.
• Write complex SQL queries to extract and format source data for pipelines.
• Create technical design documents and Source to Target Mapping (STM) documentation.
• Manage code versioning and environment deployments using DevOps tools.

Required Skills

• 15+ years of experience in ETL and Data Warehousing.
• Strong expertise in Azure Cloud, ADF, Azure Synapse Analytics, and Azure Hub Events.
• In-depth knowledge of SSIS and StreamSets ETL tools.
• Hands-on experience with Data Lakehouse architecture.
• Proven experience executing at least 2 Azure Cloud Data Warehousing projects.
• Proficiency in writing complex SQL for data analysis and extraction.
• Experience with semi-structured data formats including JSON, Parquet, and XML.

Preferred Skills

• Experience with data profiling, data mapping, and data quality frameworks.

Key Skills

Education

Any Graduate