Description

Design and implement solutions for large-scale data processing challenges.

Responsibilities

• Design, build, and maintain efficient, reusable, and reliable code for big data systems.
• Own tasks end-to-end, from implementation and testing to troubleshooting and correction.
• Drive architectural, design, and status discussions with multiple stakeholders.
• Implement solutions for problems arising from large-scale data processing.
• Conduct technical training, write whitepapers, and share knowledge across teams.

Required Skills

• 8+ years of software development experience in Big Data technologies.
• Deep expertise in Apache Spark, Hive, and Hadoop.
• Proficiency in Scala, Python, and Java.
• Experience building and tuning Spark pipelines.
• Ability to write complex Hive queries to derive business-critical insights.
• Experience with NoSQL technologies including MongoDB and DynamoDB.
• Strong understanding of Hadoop distributions and core big data concepts.
• Bachelor's degree or equivalent experience.

Preferred Skills

• Experience with AWS Cloud services such as Lambda, EMR, and Kinesis.

Key Skills

Education

Any Graduate