Description

You will own data integration and processing tasks within the Azure ecosystem, leveraging Azure Data Factory, Spark, and Databricks.

Responsibilities

• Develop and maintain scalable data pipelines using PySpark and Databricks.
• Write, optimize, and debug complex SQL queries for data manipulation and analysis.
• Manage and orchestrate data workflows across the Azure ecosystem.
• Ensure efficient data integration and processing for large-scale datasets.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency in PySpark for large-scale data processing.
• Hands-on experience with Databricks.
• Strong command of SQL.
• Experience with Azure Data Factory.
• Bachelor's degree or equivalent experience in any graduate field.

Key Skills

Education

Any Graduate