Description

You will build and manage scalable data pipelines using Java and Apache Spark.

This role is on-site.

Responsibilities

• Design, develop, and maintain ETL processes to ingest, transform, and store large data volumes.
• Optimize data processing jobs for performance and cost-efficiency.
• Ensure data quality, integrity, and security across all pipelines and storage solutions.
• Develop and maintain data models, schemas, and technical documentation.
• Monitor and troubleshoot pipeline issues to ensure high availability.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Hands-on experience with Apache Spark and Java.
• Proficiency with AWS services including S3, EMR, Lambda, and Glue.
• Experience with Snowflake and ETL processes.
• Strong SQL and NoSQL database knowledge.
• Experience with CI/CD tools including Jenkins and Spinnaker.
• Any Graduate degree.

Preferred Skills

• Experience collaborating with data scientists and analysts to define data requirements.

Key Skills

Education

Any Graduate