Description

You will design, develop, and maintain data pipelines and ETL processes using Azure Databricks. This role owns data quality, governance, and performance optimization while mentoring junior developers.

This role is on-site.

Responsibilities

• Build and maintain scalable data pipelines and ETL workflows in Azure Databricks.
• Translate business requirements into technical specifications and data models.
• Optimize data workflows, troubleshoot performance issues, and implement data governance best practices.
• Conduct code reviews and provide mentorship to junior developers.
• Participate in Agile ceremonies including sprint planning and retrospectives.

Required Skills

• 10+ years of software development experience with a focus on data engineering.
• Strong expertise in Azure Databricks and its ecosystem.
• Proficiency in Python, Scala, or Java.
• Experience with data modeling, data warehousing, and data lake architectures.
• Solid understanding of SQL and database technologies.
• Familiarity with Azure cloud services and Git version control.
• Bachelor's degree in Computer Science, Information Technology, or a related field.

Preferred Skills

• Knowledge of machine learning frameworks and libraries.
• Experience with data visualization tools such as Power BI or Tableau.
• Familiarity with Docker, Kubernetes, and CI/CD pipelines.

Key Skills

Education

Bachelor's degree