Description

You will design and maintain data engineering solutions on the Azure platform. You own the development, testing, and deployment of data pipelines using Azure Data Factory and Databricks.

Responsibilities

• Develop and optimize ETL/ELT pipelines using Azure Data Factory.
• Build and maintain data processing workflows with Python and PySpark on Databricks.
• Collaborate with engineering teams to ensure data integrity and performance.
• Implement best practices for code quality, testing, and CI/CD within the data engineering lifecycle.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Strong proficiency in Azure Data Factory (ADF) for orchestration and data movement.
• Hands-on experience with Python and PySpark for data processing.
• Demonstrated experience using Databricks for scalable analytics.
• Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.

Key Skills

Education

Bachelor’s or Master’s degree in Computer Science