Description

You will design, build, and operate large-scale enterprise big data platforms and data streaming use cases.

Responsibilities

• Design and operate enterprise-grade data streaming architectures using Kafka, Spark Streaming, Storm, or Flink.
• Build and manage large-scale enterprise-level big data platforms on AWS and Databricks.
• Perform analysis on large datasets to drive business intelligence delivery.
• Collaborate within a mature, self-organized agile team to deliver data engineering outcomes.
• Articulate specific use cases and the outcomes they support.

Required Skills

• 10+ years of experience as a big data engineer.
• Proficiency in PySpark, Spark, Python, Scala, Hive, Pig, and MapReduce.
• Strong experience with AWS and Databricks.
• Advanced SQL skills.
• Experience designing and operating data streaming architectures.
• Degree in Computer Science, Applied Mathematics, Engineering, or equivalent work experience.

Key Skills

Education

Degree in Computer Science