Description

Build and manage data pipelines within a large-scale data environment.

Responsibilities

• Design, develop, and maintain ETL pipelines using Ab Initio or comparable tools.
• Migrate legacy ETL processes to a Spark-based framework.
• Optimize ETL processes for performance and efficiency.
• Troubleshoot and resolve data extraction, transformation, and loading issues while ensuring data quality.
• Collaborate with data analysts and stakeholders to define data requirements.

Required Skills

• 4-5 years of experience in ETL development.
• Hands-on expertise with Ab Initio, Informatica, or Talend.
• Proficiency in core Java development.
• Experience working with big data in large organizations.
• Proven track record of designing and building ETL pipelines.
• Experience with Kafka, Unix scripting, Python, or Scala.

Preferred Skills

• Experience with AWS cloud services.
• Knowledge of Hadoop and Spark for big data processing.

Any Graduate degree.

Key Skills

Education

Any Graduate