Description

You will own data integration and processing tasks within the Azure ecosystem, leveraging Azure Data Factory, Spark, and Databricks.

Since all work mode flags are zero, no remote or on-site line is included.

Responsibilities

• Develop and maintain scalable data pipelines using PySpark and Databricks.
• Write, optimize, and debug complex SQL queries for data manipulation and analysis.
• Manage and orchestrate data workflows across the Azure ecosystem.
• Ensure efficient data integration and processing for large-scale datasets.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency in PySpark for large-scale data processing.
• Hands-on experience with Databricks.
• Strong command of SQL.
• Experience with Azure Data Factory.
• Bachelor's degree or equivalent experience in any graduate field.

Preferred Skills

• Experience with large-scale dataset processing.

Key Skills

Education

Any Graduate