Description

Design and develop data pipelines within a large, complex data analytics environment.

Responsibilities

• Build and maintain ETL pipelines to support data analytics workflows.
• Migrate legacy ETL processes to a Spark-based processing framework.
• Develop data processing logic using Core Java, Scala, or Python.
• Manage data movement and transformation within big data ecosystems.

Required Skills

• 5+ years of experience in ETL development and pipeline engineering.
• Expertise in Ab Initio.
• Strong background in Core Java (focused on data processing rather than UI/J2EE).
• Proficiency in Scala or Python as an alternative to Java.
• Hands-on experience with Hadoop and Spark.
• Knowledge of AWS cloud environments.

Preferred Skills

• Experience with Kafka, Unix, and Python.
• Familiarity with AWS-based data migrations.

Key Skills

Education

Any gradudate