Description

You will lead the design, development, and maintenance of ETL pipelines across hybrid on-premise and cloud ecosystems.

Responsibilities

• Design and develop complex ETL workflows using IBM DataStage and Azure Data Factory.
• Lead and coordinate offshore development teams to ensure delivery against timelines and quality standards.
• Execute ETL migration projects, specifically transitioning DataStage workloads to ADF or cloud pipelines.
• Build and manage data pipelines using Databricks while implementing data quality and lineage practices.
• Automate pipeline deployment and version control using CI/CD practices within Azure DevOps.

Required Skills

• 8+ years of experience in data engineering across ETL and cloud-based integration.
• 4+ years of hands-on experience with IBM DataStage development and optimization.
• 4+ years of experience with Azure Data Factory, Azure SQL Database, and Azure-native services.
• Proficiency in SQL and Python for data manipulation and orchestration logic.
• Experience with Azure Synapse Analytics and Azure Data Lake.
• Hands-on expertise with Databricks for data pipeline management.
• Practical knowledge of CI/CD using Azure DevOps.
• Experience implementing data governance, security, and compliance in Azure.

Key Skills

Education

Not specified