Description

You will build and optimize scalable data pipelines and analytics solutions on Azure. You own the lifecycle from ingestion to visualization, ensuring performance, governance, and reliability.

Responsibilities

• Develop high-performance ETL/ELT pipelines using PySpark and SQL within Databricks.
• Implement Delta Lake best practices and optimize cluster configurations for cost and speed.
• Build and maintain Power BI dashboards, adhering to data modeling and performance best practices.
• Manage Azure data services including ADLS and ADF, with Git-based CI/CD via Azure DevOps.
• Deliver end-to-end AI/ML projects, covering model development, training, evaluation, and deployment.

Required Skills

• 5+ years of experience in data engineering roles.
• Expertise in Databricks: Spark, SQL, Delta Lake, notebooks, and cluster optimization.
• Strong proficiency in PySpark and SQL for complex data transformations.
• Hands-on experience building Power BI dashboards and implementing PBI best practices.
• Deep understanding of Azure data services: ADLS, ADF, Azure DevOps, and Git-based CI/CD.
• Proven ability to optimize data pipelines, data models, and Power BI datasets for scalability.
• Bachelor's degree in Computer Science or a related field.

Key Skills

Education

Bachelor's degree