Description

You own the development and maintenance of data pipelines for the Data Engineering team.

This role is hybrid.

Responsibilities

• Build and maintain data pipelines using Spark, Python, and Airflow to extract, transform, and load data from diverse sources.
• Collaborate with internal and external stakeholders to resolve data quality and technical issues.
• Conduct proofs of concept and technical demonstrations for customers and technical teams.
• Participate in agile ceremonies and triage production defects.

Required Skills

• 7+ years of professional engineering experience.
• Proficiency in Python and PySpark.
• Strong command of Airflow.
• Experience with Spark architecture and processing large structured and unstructured datasets.
• Advanced SQL knowledge, preferably with Oracle.
• Solid understanding of Object-Oriented and Functional Programming paradigms.
• Experience with GitHub and Jenkins.
• Familiarity with software engineering best practices and AWS.

Preferred Skills

• Any Graduate.

Key Skills

Education

Any Graduate