Description

You will design, implement, and optimize data pipelines within the Azure ecosystem. This role is on-site.

Responsibilities

• Design and manage ETL/ELT pipelines using Azure Data Factory to integrate data from SQL databases, Blob Storage, Data Lake, and APIs.
• Implement complex transformation logic using Azure Data Factory Data Flow and Mapping Data Flow.
• Monitor pipelines to ensure performance, reliability, and cost-effectiveness while troubleshooting workflow failures.
• Collaborate with data scientists and analysts to translate business requirements into scalable data solutions.
• Enforce data security measures and ensure compliance with governance and regulatory requirements.

Required Skills

• 5+ years of experience in data engineering with a focus on Azure Data Factory.
• Proficiency in SQL and T-SQL.
• Hands-on experience with Python and PowerShell.
• Experience with Azure SQL Database, Azure Data Lake, and Blob Storage.
• Practical knowledge of Git for version control.
• Strong understanding of data warehousing concepts and data modeling.
• Experience with CI/CD practices.
• Familiarity with Azure Synapse Analytics and Azure Databricks.

Preferred Skills

• Experience with ETL/ELT tools such as SSIS, Informatica, or Talend.
• Azure certifications including Azure Data Engineer Associate or Azure Solutions Architect.

Key Skills

Education

Any Graduate