Description

You will engineer and maintain data solutions using Azure Databricks.

Responsibilities

• Develop and optimize data pipelines using PySpark and Python within a Data Lake environment.
• Design, build, and manage CI/CD pipelines for data workflows.
• Implement and maintain Azure Pipelines for automated deployments.
• Manage infrastructure and services within the Azure Cloud.

Required Skills

• 5+ years of professional experience in data engineering.
• Expertise with Databricks and PySpark.
• Strong proficiency in Python and scripting.
• Hands-on experience with Data Lake architectures.
• Proven ability to create and manage CI/CD pipelines.
• Experience with Azure Pipeline creation.
• Solid background in Azure Cloud services.

Key Skills

Education

Any Graduate