Description

You will design system solutions and develop custom applications to transition legacy batch-based platforms to event-driven, microservices-based architectures.

Responsibilities

• Design, develop, and modify software applications to meet changing business requirements.
• Translate user needs into system architecture and provide process flow diagrams.
• Handle coding, debugging, documentation, and testing for engineering resilience.
• Partner with SRE, testing, and production support teams to ensure smooth development life-cycle transitions.
• Provide post-implementation and ongoing production support.

Required Skills

• 5+ years of software development experience, including leading engineering and scrum teams.
• 3+ years of hands-on experience with Spark (core, SQL, and PySpark), Hive, and Map-Reduce.
• Expertise in writing and optimizing complex SQL, Hive, and PySpark dataframes for large-scale data processing.
• Proficiency in Python, Scala, and UNIX shell scripting.
• Strong understanding of Hadoop and Spark architecture and working principles.
• Ability to design and develop optimized data pipelines for both batch and real-time processing.
• Experience with NoSQL databases such as HBase, Couchbase, or MongoDB.
• Capability to develop technical and functional specifications and analyze system processing flows.

Preferred Skills

• 2+ years of experience designing solutions using Kafka streams or queues.
• Knowledge of cloud platforms (GCP/AWS) and building scalable microservices.
• Experience with GitHub and leveraging CI/CD pipelines.

Key Skills

Education

Any Graduate