Description

You will build and manage scalable data pipelines using Java and Apache Spark.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Apache Spark and Java.
• Implement ETL processes and data processing workflows to ingest, transform, and store large volumes of data.
• Optimize and tune data processing jobs for performance and cost-efficiency.
• Ensure data quality, integrity, and security across all pipelines and storage solutions.
• Develop and maintain data models, schemas, and documentation.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Proficiency with Apache Spark and Java.
• Hands-on experience with AWS services including S3, EMR, Lambda, and Glue.
• Experience with SQL and NoSQL databases.
• Knowledge of ETL processes.
• Experience with Snowflake.
• Familiarity with CI/CD, Jenkins, and Spinnaker.

Preferred Skills

• Strong knowledge of Snowflake implementation.

Key Skills

Education

Any Graduate