Description

You will design and implement data processing solutions within the Azure ecosystem.

Responsibilities

• Build and maintain data pipelines using Spark and Scala.
• Manage data storage and retrieval within Azure Data Lake Store.
• Execute data transformations and queries using Databricks SQL.
• Deploy and manage infrastructure through Azure DevOps.
• Optimize data workflows using Python and Databricks CLI.

Required Skills

• 10+ years of professional experience in data engineering.
• Proficiency with Spark and Scala.
• Hands-on experience with Databricks CLI and Databricks SQL.
• Deep understanding of Azure Data Lake Store and Azure Data services.
• Strong programming skills in Python.
• Experience managing CI/CD workflows with Azure DevOps.
• Bachelor's degree in any field.

Key Skills

Education

Any Gradute