Description

You will design and build large-scale data processing systems and streaming applications.

Responsibilities

• Develop and maintain data pipelines using Python, Scala, or Java.
• Implement real-time data processing and streaming applications.
• Manage and optimize NoSQL databases and data warehousing solutions.
• Operate distributed computing tools within public cloud environments.
• Apply Agile engineering practices to the data development lifecycle.

Required Skills

• 5+ years of experience in application development.
• 3+ years of experience with distributed data and computing tools including MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL.
• 3+ years of experience with UNIX/Linux, including basic commands and shell scripting.
• 2+ years of experience with public cloud platforms (AWS, Microsoft Azure, or Google Cloud).
• 2+ years of experience with real-time data and streaming applications.
• 2+ years of experience with NoSQL implementation (Mongo or Cassandra).
• 2+ years of experience with data warehousing (Redshift or Snowflake).
• 2+ years of experience with Agile engineering practices.
• 1+ year of experience specifically with big data technologies.
• Proficiency in Python, SQL, Scala, or Java.
• Bachelor's degree or equivalent graduate qualification.

Key Skills

Education

Any Graduate