Description

You will build and maintain data pipelines within the C1 ecosystem using Java and Spark.

This role is hybrid.

Responsibilities

• Build and maintain ETL pipelines for data extraction and loading.
• Receive files from Discover and transfer them into the C1 ecosystem.
• Manage data migration tasks through ETL processes.
• Develop big data integrations using Java, Spark, and AWS Glue.

Required Skills

• 12+ years of professional experience in data engineering.
• Strong, hands-on experience with ETL processes.
• Expertise in Spark for big data processing.
• Proficiency in Java, specifically for big data integration, not API backend development.
• Hands-on experience with AWS Glue.
• Familiarity with AWS services such as Step Functions and Lambda.

Preferred Skills

• Experience with data migration tasks in large-scale ecosystems.

Key Skills

Education

Any Graduate