Description

You will own the design and optimization of data pipelines and analytics solutions on the Azure platform. You build scalable ETL/ELT workflows, manage data governance, and deliver high-performance Power BI dashboards.

Responsibilities

• Build and optimize high-performance ETL/ELT pipelines using PySpark, SQL, Databricks, and Delta Lake.
• Design and implement Power BI dashboards, applying best practices for dataset performance and governance.
• Manage Azure data services including ADLS, ADF, and Unity Catalog for secure data access and storage.
• Implement Git-based CI/CD workflows using Azure DevOps to ensure reliable deployment of data assets.
• Deliver end-to-end AI/ML projects, covering model development, training, evaluation, and deployment.

Required Skills

• 5+ years of experience in data engineering roles.
• Expertise in Databricks: Spark, SQL, Delta Lake, notebooks, and cluster optimization.
• Strong proficiency in PySpark and SQL for data transformation and pipeline construction.
• Hands-on experience building Power BI dashboards and optimizing Power BI datasets.
• Deep understanding of Azure data services: ADLS, ADF, and Azure DevOps.
• Experience with Git-based CI/CD pipelines.
• Proven ability to optimize data models and pipelines for scalability, performance, and governance.

Preferred Skills

• Experience delivering end-to-end AI/ML projects, including model development and deployment.

Key Skills

Education

Any Gradute