Description

You will build and manage data pipelines within an Azure cloud environment.

This role is remote.

Responsibilities

• Develop and maintain data workflows using Databricks and Delta Lake.
• Write and optimize complex SQL queries for data analysis and querying.
• Manage data orchestration using workflow tools like Airflow or Oozie.
• Execute API testing and validation using Postman.
• Operate within Unix/Linux environments using shell scripting.

Required Skills

• 5+ years of experience in data engineering roles.
• Strong proficiency in SQL for data querying and analysis.
• Hands-on experience with Azure Cloud services.
• Direct experience with Databricks and Delta Lake.
• Working knowledge of Airflow or Oozie for workflow management.
• Proficiency in Unix/Linux environments and shell scripting.
• Experience performing API testing with Postman.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate