Description

You will build and maintain data pipelines using PySpark and Airflow in Jersey City, NJ.

Responsibilities

• Develop data processing workflows using Python and PySpark.
• Manage and orchestrate data pipelines through Airflow.
• Execute data analytics and manage queries within Oracle and SQL databases.
• Utilize Jupyter Hub for data exploration and development.
• Analyze complex datasets to support regulatory reporting requirements.

Required Skills

• 5+ years of professional experience in data development.
• Proficiency in Python and PySpark.
• Hands-on experience with Airflow for orchestration.
• Strong SQL and Oracle database knowledge.
• Experience using Jupyter Hub.
• Competency in Java.
• Solid understanding of Data Analytics.
• Degree in any graduate field.

Key Skills

Education

Any Graduate