Description

job responsibilities include:

Develop and enhance application components for supporting ML/AI models and data ingestion processes with a focus on code resiliency and stability.

Build processes to interact with HDFS and Oracle using Python/PySpark and Oracle PL/SQL.

Create, schedule, and manage workflows and jobs using Autosys.

Collaborate with development teams to contribute to story refinement and deliver data requirements throughout the delivery life cycle.

Leverage architecture components to integrate, clean, transform, and control data as per acceptance criteria.

Develop and execute test plans to identify issues, errors, and underlying causes, ensuring data accuracy and reliability.

Drive complex information technology projects, ensuring on-time delivery and adherence to team delivery and release processes.

Identify, define, and document data engineering requirements for deployment, maintenance, and business functionality.

Work independently with strong analytical skills, while also being an excellent team player in a fast-paced agile environment.

Contribute to data resiliency capabilities and ensure that ML/AI models are ready for production.

Desired Qualifications:

BS/master’s in computer science, Engineering, or a related field.

10+ years of relevant experience in Big Data engineering and development.

Expertise in Oracle PL/SQL, Hadoop ecosystem, Hive Tables, and Python/PySpark.

Experience in creating workflows and scheduling jobs using Autosys, with a strong background in machine learning and data resiliency

Key Skills

Education

Any Graduate