Description

You will build and maintain data pipelines and application components to support ML/AI models and data ingestion, focusing on code resiliency and stability.

This role is hybrid.

Responsibilities

• Build processes to interact with HDFS and Oracle using Python, PySpark, and Oracle PL/SQL.
• Create, schedule, and manage workflows and jobs using Autosys.
• Integrate, clean, transform, and control data to meet acceptance criteria.
• Develop and execute test plans to identify issues, ensuring data accuracy and reliability.
• Drive complex IT projects, ensuring on-time delivery and adherence to release processes.

Required Skills

• 10+ years of experience in Big Data engineering and development.
• Expertise in Oracle PL/SQL.
• Strong background in the Hadoop ecosystem and Hive Tables.
• Proficiency in Python and PySpark.
• Experience creating workflows and scheduling jobs using Autosys.
• BS or Master’s in Computer Science, Engineering, or a related field.

Key Skills

Education

Any Graduate