Description

You will design, build, and maintain scalable data pipelines and analytics infrastructure on Azure.

This role is on-site.

Responsibilities

• Design and maintain scalable data pipelines using Azure Databricks and Apache Spark.
• Implement complex data transformations using Spark SQL and Python.
• Build and manage analytics models using DBT Core or DBT Cloud.
• Orchestrate data ingestion and transformation workflows using Azure Data Factory.
• Develop and manage CI/CD pipelines and source control using Azure DevOps.

Required Skills

• 5+ years of experience as a Data Engineer.
• Strong expertise in Spark SQL and Python programming.
• Hands-on experience with Azure Databricks, including at least one real-time project implementation.
• Proficiency with DBT Core and/or DBT Cloud.
• Experience building and managing pipelines using Azure Data Factory.
• Proficiency with Azure DevOps (Repos, Pipelines, CI/CD).
• Experience using AI-assisted tools for development or analysis.
• Solid understanding of data warehousing concepts, ETL/ELT patterns, and distributed data processing.
• Bachelor's degree in a relevant field.

Preferred Skills

• Databricks Certification (Associate or Professional).
• Experience with Azure data ecosystem (ADLS Gen2, Azure SQL, Synapse).

Key Skills

Education

Bachelor's degree