Description

You will design, develop, and maintain scalable data pipelines using Databricks and Azure.

This role is on-site.

Responsibilities

• Design and optimize data pipelines using Databricks (Spark/Scala) on Azure.
• Write efficient SQL for ETL processes, validation, and reporting.
• Implement best practices for code quality, testing, and deployment.
• Collaborate with stakeholders to translate business requirements into technical solutions.

Required Skills

• 6+ years of hands-on experience in software or data engineering.
• Strong proficiency in Scala and Spark (RDD, DataFrame, SQL).
• Hands-on experience with the Databricks platform.
• Experience with Azure cloud services, specifically Azure Data Factory.
• Advanced knowledge of Python for scripting and automation.
• Strong background in database design and development (T-SQL/PLSQL).
• Understanding of CI/CD pipelines for automated cloud deployments.
• Experience working within Agile/Scrum methodologies.

Preferred Skills

• Familiarity with .NET APIs or React-based UIs.

Key Skills

Education

Bachelor's or Master's degrees