Description

You will build and maintain data pipelines and processing jobs.

This role is remote.

Responsibilities

• Develop and manage Azure Data Factory pipelines.
• Implement data processing jobs using Databricks and Spark.
• Write and optimize complex Spark SQL queries.
• Develop data solutions using Python.
• Maintain and refactor codebases in Scala.

Required Skills

• 5+ years of professional experience.
• Expertise in Azure cloud services.
• Strong experience with Azure Data Factory.
• Proficiency in Databricks and Spark.
• Solid command of SQL.
• Experience developing in Python.
• Familiarity with Scala is required.

Preferred Skills

• Experience with R.

Key Skills

Education

Any Graduate