Description

You will engineer and maintain data pipelines in cloud environments.

Responsibilities

• Develop and optimize data processing jobs using PySpark.
• Manage and implement data storage solutions utilizing ADLS and Delta Tables.
• Design and automate ETL workflows using ADF.
• Write and tune complex queries using SparkSQL.

Required Skills

• 12+ years of professional experience in data engineering.
• Expertise with Azure ecosystem components.
• Proficiency in PySpark development.
• Hands-on experience with Azure Data Factory (ADF).
• Working knowledge of Azure Data Lake Storage (ADLS).
• Experience implementing and managing Delta Tables.
• Strong command of SparkSQL.

Key Skills

Education

Any Graduate