Description

You will design and maintain scalable big data systems on AWS, building high-throughput pipelines and managing cloud infrastructure.

This role is hybrid.

Responsibilities

• Implement and maintain critical data systems for consistent performance and availability.
• Develop and operate scalable data pipelines using Apache Spark and Scala.
• Manage AWS cloud infrastructure, including Lambda, SNS, S3, Step Functions, EC2, and ECR.
• Design and maintain high-throughput messaging systems using Apache Kafka.
• Collaborate within an Agile framework to deliver data solutions.

Required Skills

• 5+ years of professional experience as a Data Engineer or similar role.
• Strong proficiency in Java (5+ years) and Scala.
• Hands-on experience with Apache Spark for big data processing.
• Practical experience with Apache Kafka for streaming data.
• Experience with MongoDB and PostgreSQL or other relational databases.
• Deep familiarity with AWS services: Lambda, S3, SNS, Step Functions, EC2, ECR.
• Proficiency with Git and GitLab for version control.
• Experience working in Agile development teams.

Preferred Skills

• Bachelor's degree in Computer Science or related field.
• Experience with batch job processing and optimization.

Key Skills

Education

Bachelor's degree