Description

You will design and manage scalable data environments and pipelines within the Azure ecosystem. This role is on-site.

Responsibilities

• Manage Azure Databricks, Azure SQL Server, Azure Data Factory, Power BI, and PowerApps environments for scalability and reliability.
• Develop and optimize fault-tolerant data pipelines for ingestion and processing.
• Establish data quality standards through validation checks and automated testing frameworks.
• Analyze data patterns to detect logical inconsistencies and anomalies.
• Document data models, pipelines, and dictionaries for technical and non-technical stakeholders.

Required Skills

• 10+ years of experience in data engineering with strong software development foundations.
• 5+ years of hands-on experience with Azure Data Factory, ADLS Gen 2, Databricks, and SQL Server.
• Proficiency in Python, SQL, and Spark.
• Experience with ETL orchestration tools such as Databricks Workflows, Airflow, Dagster, or Prefect.
• Expertise in REST APIs and web services.
• Proficiency in Git and Azure DevOps.
• Experience with data quality validation and analytical troubleshooting.
• Ability to design scalable, well-structured data models.

Preferred Skills

• Degree in Computer Science, Information Systems, Statistics, or a related field.

Key Skills

Education

Any Graduate