Description

You will design system solutions and develop custom applications to transition legacy batch-based platforms to event-driven, microservices-based architectures.

Responsibilities

• Design and develop software applications by translating user needs into system architecture.
• Build and optimize data pipelines for both batch and real-time data processing.
• Collaborate with SRE, testing, and production support teams to ensure smooth development life-cycle transitions.
• Perform coding, debugging, documentation, and validation of application performance and component integration.
• Test the engineering resilience of software and automation tools.

Required Skills

• 5+ years of software development experience, including leading teams of engineers and scrum teams.
• 3+ years of hands-on experience with Spark (core, SQL, and PySpark), Hive, and Map-Reduce.
• Expertise in Python, Scala, and UNIX shell scripting.
• Advanced SQL skills, including Hive and PySpark dataframes, with a focus on optimizing joins for large-scale data processing.
• Strong understanding of Hadoop and Spark architecture and working principles.
• Experience in the analysis, design, development, testing, and implementation of system applications.
• Ability to develop technical and functional specifications and analyze system processing flows.
• Bachelor's degree in Engineering, Computer Science, or equivalent.

Preferred Skills

• 2+ years of experience designing solutions using Kafka streams or queues.
• Experience with cloud platforms (GCP/AWS), microservices, and NoSQL databases such as HBase, Couchbase, or MongoDB.
• Knowledge of GitHub and CI/CD pipelines.

Key Skills

Education

Any Graduate