Description

Design, build, and operate large-scale enterprise big data platforms and streaming architectures on AWS.

This role is on-site.

Responsibilities

• Design and build enterprise-grade data streaming architectures.
• Develop and operate large-scale big data platforms on AWS.
• Perform analysis using large datasets to drive business intelligence.
• Collaborate within a self-organized agile team to articulate use cases and outcomes.

Required Skills

• 7+ years of experience as a big data engineer.
• Proficiency in PySpark, Spark, Python, and Scala.
• Hands-on experience with Hive, Pig, and MapReduce.
• Strong expertise in AWS and Databricks.
• Advanced SQL skills.
• Experience designing streaming use cases using Kafka, Spark Streaming, Storm, or Flink.
• Degree in Computer Science, Applied Mathematics, Engineering, or equivalent work experience.

Key Skills

Education

Degree in Computer Science