Description

Build and optimize data pipelines within the Azure cloud ecosystem.

Responsibilities

• Develop data engineering solutions using Python, Spark, and Scala.
• Write and optimize Databricks code and complex SQL queries.
• Manage cluster configurations and performance tuning.
• Design and implement ETL processes and data warehousing structures.

Required Skills

• 8 years of professional experience in data engineering.
• Proficiency in Python, Spark, and Scala.
• Strong expertise in Databricks coding and query optimization.
• Deep understanding of cluster operations and optimization.
• Advanced SQL skills.
• Experience with ETL tools and data warehousing concepts.
• Knowledge of Azure services including ADF, Dataflows, Function Apps, Web Apps, and Logic Apps.
• Experience with Event Grid or Kafka.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate