Description

Build and manage data pipelines on Microsoft Azure, integrating, transforming, and loading data for analytics.

This role is on-site.

Responsibilities

• Design, develop, and maintain ETL/ELT processes to move and transform data.
• Cleanse, map, and optimize data for analysis.
• Manage data stores including data lakes, Synapse data warehouses, and databases.
• Deploy production code and automate data workflows.
• Support data scientists, analysts, and developers with data needs.

Required Skills

• 10+ years of professional engineering experience.
• Expert proficiency in SQL for complex querying.
• Strong scripting and data processing skills in Python.
• Hands-on experience with Azure Data Factory (ADF).
• Experience using Azure Databricks and Apache Spark.
• Familiarity with Azure Synapse Analytics and Azure Cosmos DB.
• Knowledge of CI/CD practices using Azure DevOps.
• Foundational knowledge of Hadoop and Data Warehousing concepts.

Key Skills

Education

Any Graduate