Description

You will build and optimize data pipelines and ML workflows as a Senior Data Engineer.

This role is on-site.

Responsibilities

• Build high-performance ETL/ELT pipelines using PySpark and SQL.
• Optimize data pipelines, models, and Power BI datasets for scale and performance.
• Deliver end-to-end AI/ML projects, covering model development through deployment.
• Manage data workflows using Databricks features like Spark, Delta Lake, and Unity Catalog.
• Implement and maintain CI/CD processes within Azure data services.

Required Skills

• 5+ years of professional experience in data engineering.
• Expertise in Databricks, including Spark, SQL, Delta Lake, and Notebooks.
• Strong proficiency in PySpark and SQL for pipeline construction.
• Hands-on experience building and implementing Power BI Dashboards and best practices.
• Understanding of Azure data services (ADLS, ADF, Azure DevOps).
• Experience with Git-based CI/CD practices.
• Familiarity with AI/ML lifecycle, including model training and evaluation.

Key Skills

Education

Any Gradute