Description

Build and manage large-scale data systems and processing pipelines.

Responsibilities

• Develop and maintain complex data systems using Python, Scala, Java, and Bash.
• Implement data processing logic using Apache Spark.
• Manage workflows within the Hadoop technology stack.
• Apply algorithmic analysis to optimize data structures and processing efficiency.

Required Skills

• 5+ years of professional experience in data engineering.
• Deep knowledge of Apache Spark.
• Proficiency in Python, Scala, Java, and Bash.
• Experience with the Hadoop stack, including MapReduce, Hive, and Sqoop.
• Strong understanding of data structures such as stacks, queues, and graphs.
• Solid grasp of algorithm analysis.
• Bachelor's degree in Computer Science, Math, Physics, or Electrical Engineering.

Key Skills

Education

Bachelor's degree in Computer Science