Description

Lead the migration of ETL workloads from Ab Initio to PySpark. You will analyze existing Ab Initio architecture and design the recommended PySpark implementation.

Responsibilities

• Evaluate current Ab Initio ETL pipelines and data flows.
• Design scalable PySpark architecture to replace legacy Ab Initio components.
• Define migration strategies and technical specifications for the transition.
• Collaborate with stakeholders to ensure data integrity during migration.

Required Skills

• 5+ years of experience in ETL development and architecture.
• Deep expertise in Ab Initio, including component design and deployment.
• Strong proficiency in PySpark for large-scale data processing.
• Experience designing migration paths from legacy ETL tools to open-source frameworks.
• Ability to translate Ab Initio logic into efficient PySpark code.

Key Skills

Education

Any Graduate