Description

You will design, build, and maintain data pipelines on the AWS Cloud platform.

This role is on-site.

Responsibilities

• Build and maintain data pipelines for optimal extraction, transformation, and loading from diverse sources using Spark, Python, and Airflow.
• Collaborate with internal and external stakeholders to resolve data and data quality issues.
• Engage in proof of concepts, technical demos, and interactions with technical teams.
• Participate in agile ceremonies and triage production defects.

Required Skills

• 5+ years of professional experience.
• Proficiency in Python and PySpark.
• Strong command of Airflow.
• Solid understanding of OOP and Functional Programming paradigms.
• Experience working with Spark architecture.
• Advanced SQL knowledge, preferably Oracle.
• Experience processing large volumes of structured and unstructured data from multiple sources.
• Knowledge of Software Engineering best practices.

Preferred Skills

• Knowledge of AWS Data related Services.
• Familiarity with GitHub and Jenkins.

Key Skills

Education

Any Graduate