Description

Key Responsibilities

• Lead a team of developers and data engineers in designing and implementing enterprise-grade solutions.
• Architect and oversee development of ETL batch pipelines using Spark and related frameworks.
• Provide technical leadership in Java/Scala programming for backend services and data processing.
• Collaborate with product owners, architects, and stakeholders to define technical roadmaps.
• Ensure adherence to coding standards, best practices, and performance optimization.
• Conduct code reviews, mentor junior engineers, and foster a culture of continuous learning.
• Drive automation, CI/CD integration, and deployment strategies.
• Troubleshoot complex issues in distributed systems and ensure high availability.
• Align development efforts with business goals and timelines in an onsite leadership capacity.

Required Skills & Experience

• Strong programming expertise in Java and Scala.
• Hands-on experience with Apache Spark (batch processing, distributed computing).
• Deep knowledge of ETL batch frameworks (e.g., Informatica, Talend, Spark ETL, custom frameworks).
• Experience with data warehousing concepts and large-scale data pipelines.
• Familiarity with cloud platforms (AWS, Azure, GCP) and big data ecosystems (HDFS, Hive, Kafka).
• Strong leadership and communication skills to manage onsite teams and coordinate with offshore PODs.
• Proven track record of delivering complex projects in Agile/Scrum environments.

Preferred Qualifications

• Exposure to streaming frameworks (Spark Streaming, Flink, Kafka Streams).
• Experience with containerization and orchestration (Docker, Kubernetes).
• Knowledge of DevOps practices and CI/CD tools (Jenkins, GitLab CI, Azure DevOps).
• Prior experience as a technical lead or architect in data-intensive projects

Key Skills

Education

Bachelor's degree