Description

You will build and maintain scalable data pipelines and distributed systems within a big data ecosystem.

This role is remote.

Responsibilities

• Design and implement new products using Java, Spark, Python, and Scala.
• Integrate new data sources and execute scalable distributed data replication strategies.
• Own product features through the entire lifecycle, from development and testing to production deployment.
• Evaluate big data technologies and prototype solutions to improve data processing architecture.
• Automate workflows and processes across the data lifecycle.

Required Skills

• 5-6 years of experience delivering enterprise software solutions.
• Proficiency in Spark, Scala, Python, and AWS Cloud technologies.
• 3+ years of experience with Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, and Kafka.
• Strong object-oriented design and analysis skills.
• Experience with data ingestion, transformation, and schema design.
• Experience working within Agile Development methodologies.
• Solid understanding of secure application development and automated QA for big data.

Preferred Skills

• Experience developing microservices using the Spring framework.
• Experience with Airflow and Python.

Key Skills

Education

Any Graduate