Description

Big Data Engineer with AWS

Responsibilities

• Implement, configure, and maintain critical data systems to ensure consistent performance and availability.
• Develop and operate scalable data pipelines using Apache Spark and Scala.
• Manage cloud infrastructure and serverless functions on AWS (Lambda, SNS, S3, Step Functions, EC2, ECR).
• Design and maintain high-throughput messaging systems using Apache Kafka.
• Collaborate within an Agile framework to deliver robust data solutions.

Required Skills

• 5+ years of professional experience as a Data Engineer or similar role.
• Strong proficiency in Java (5+ years) and Scala.
• Hands-on experience with Apache Spark for big data processing.
• Practical experience with Apache Kafka for streaming data.
• Experience with MongoDB and PostgreSQL or other relational databases.
• Deep familiarity with AWS services including Lambda, S3, SNS, Step Functions, EC2, and ECR.
• Proficiency with Git and GitLab for version control.
• Experience working in Agile development teams.

Preferred Skills

• Bachelor's degree in Computer Science or related field.
• Experience with batch job processing and optimization.

Key Skills

Education

Bachelor's degree