Description

You will build and maintain scalable data pipelines and ETL workflows using Java and Apache Spark.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Apache Spark and Java.
• Implement ETL processes to ingest, transform, and store large volumes of data.
• Optimize and tune data processing jobs for performance and cost-efficiency.
• Monitor and troubleshoot pipeline issues to ensure high availability and reliability.
• Develop and maintain data models, schemas, and documentation.

Required Skills

• 10+ years of professional experience.
• Proficiency in Java and Apache Spark.
• Hands-on experience with AWS services including S3, EMR, Lambda, and Glue.
• Experience with Snowflake.
• Strong knowledge of SQL and NoSQL databases.
• Experience implementing ETL processes.
• Experience with CI/CD, Jules, and Spinnaker.
• Any Graduate degree.

Key Skills

Education

Any Graduate