Description

You will build and maintain data pipelines using PySpark and Python, focusing on ETL processes and workflow orchestration.

Responsibilities

• Build and manage ETL processes to handle data integration.
• Develop workflows and orchestration using Airflow.
• Analyze data sets using SQL and Oracle databases.
• Utilize Jupyter Hub for data exploration and development.

Required Skills

• 5+ years of experience in data development roles.
• Proficiency in Python and PySpark.
• Experience with Airflow for workflow orchestration.
• Strong SQL and Oracle database knowledge.
• Hands-on experience with Jupyter Hub.
• Foundational knowledge of Java.
• Solid understanding of Data Analytics and ETL principles.

Preferred Skills

• Prior experience with regulatory reporting.
• Demonstrated experience in ETL development.

Key Skills

Education

Any Graduate