Description

You will build and maintain large-scale data processing applications and system architectures.

Responsibilities

• Build and manage data ingestion and processing pipelines using Spark and Spark Streaming.
• Implement messaging systems using Kafka, Flume, ActiveMQ, MQSeries, or RabbitMQ.
• Design and implement RESTful web services.
• Develop software following the full SDLC and TDD principles using JUnit.
• Mentor junior team members to ensure high-quality deliverables.

Required Skills

• 8+ years of experience in software development.
• 5+ years of hands-on experience with Java/J2EE.
• Experience with Hadoop distributions (Hortonworks) including HDFS, HBase, Hive, and ORC/Parquet.
• Proficiency with messaging systems like Kafka, Flume, ActiveMQ, MQSeries, or RabbitMQ.
• Experience with Spark and Spark Streaming.
• Hands-on use of Maven, sbt, or Ant.
• Experience with Jenkins or TeamCity for CI/CD.
• Proficiency in version control using SVN or Git.
• Bachelor’s degree in Computer Science, IT, Programming & Systems Analysis, or Computer Studies.

Preferred Skills

• Experience with Phoenix, Elasticsearch, Sqoop, or StreamSets.
• Solution design using proven patterns and performance tuning for streaming.
• Basic understanding of finance and investment banking.

Key Skills

Education

Bachelor’s degree