Description

You will build and maintain data pipelines within the Azure ecosystem to handle large-scale datasets.

Responsibilities

• Develop scripts to process both structured and unstructured data.
• Implement methods to improve data reliability, efficiency, and quality.
• Translate business data needs into technical system requirements.
• Collaborate with stakeholders to ensure data structure, availability, scalability, and accessibility.

Required Skills

• 3.5 to 6 years of experience in Azure Data Engineering.
• Proven experience processing large datasets exceeding 500 GB.
• Advanced SQL proficiency.
• Strong Python programming skills.
• Hands-on experience with Databricks and PySpark.
• Mandatory Azure Certification.
• Experience with at least 2 or 3 large-scale data projects.
• Ability to work in a 2nd shift schedule.
• Degree in Computer Science, Applied Mathematics, Engineering, or a related field.

Key Skills

Education

Any Graduate