Description

You will build and maintain data pipelines and ETL processes within the Azure ecosystem.

Responsibilities

• Design and implement ETL processes, including data extraction, transformation, loading, and workflow orchestration.
• Integrate diverse data sources across on-premises and cloud environments using Azure ETL services.
• Develop data pipelines using Azure Data Factory, Synapse workspaces, and PolyBase.
• Optimize query performance, manage data cleansing, aggregation, and normalization, and troubleshoot ETL processes.
• Manage data security and compliance when working with high-sensitivity data in Azure.

Required Skills

• 10+ years of experience in ETL development and data pipeline architecture.
• Proficiency in Azure Data Factory (ADF), Azure Synapse workspaces, and PolyBase.
• Expertise in T-SQL and PL/SQL for data manipulation and physical database design.
• Strong experience with Azure SQL Databases, SQL Server, and Oracle.
• Hands-on experience with Python and Azure-specific scripting via PowerShell or Azure CLI.
• Deep understanding of DataVerse / Common Data Service (CDS) and Dynamics integration technologies.
• Experience with Azure storage including Data Lake and Blob Storage.
• Competency in Azure DevOps, CI/CD processes, and version control using Azure Repos.
• Knowledge of data modeling tools, specifically ERWIN.

Preferred Skills

• Azure cloud certifications.
• Experience with Azure resource administration, including Key Vault and Application Insights.

Key Skills

Education

Any Graduate