Description

Key Skills: SCALA, AWS, Java, Big Data, Python, Data quality, Databricks, Scalability

Roles and Responsibilities:

• Lead and mentor a team of big data and backend engineers to deliver scalable data platform solutions.
• Architect and develop cloud-native data platforms for real-time and batch processing workloads.
• Build and optimize scalable, high-availability data pipelines and distributed systems.
• Drive end-to-end delivery of data platform features aligned with business and technical goals.
• Develop and maintain big data applications using Scala, Java, Python, Spark, Flink, and Kafka.
• Design scalable AWS-based solutions using services such as S3, EMR, Lambda, Glue, and Kinesis.
• Implement infrastructure automation, CI/CD, deployment, and monitoring best practices.
• Ensure system scalability, reliability, observability, and operational efficiency across platforms.
• Lead incident management, troubleshooting, root cause analysis, and long-term issue resolution.
• Collaborate with Product, Engineering, Data Science, and Operations teams to define and deliver technical solutions.
• Support adoption of new technologies and engineering practices to improve platform capabilities and delivery efficiency.
• Maintain technical architecture, documentation, and engineering standards.

Skills Required:

• Strong hands-on experience in Scala, Java, and Python development.
• Expertise in Big Data technologies including Spark, Spark Streaming, Flink, Kafka, and distributed data processing systems.
• Strong experience with AWS services such as S3, EMR, Lambda, Glue, Kinesis, IAM, and ALB.
• Experience with Databricks, Snowflake, SingleStore, and cloud-native data platforms.
• Knowledge of Terraform, Kubernetes (K8s), and Spinnaker for infrastructure automation and deployment.
• Experience with microservices architecture using Spring Boot, Spring Cloud, FastAPI, or NestJS.
• Understanding of Airflow and workflow orchestration frameworks.
• Good understanding of scalability, data quality, observability, and platform reliability concepts.
• Experience with CI/CD pipelines, automated testing, and engineering best practices.
• Strong analytical, troubleshooting, and root cause analysis skills.
• Experience working in Agile development environments.
• Excellent communication, leadership, and stakeholder management skills.

Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

• Master's degree or certifications in Cloud, Big Data, or Data Engineering technologies are an added advantage

Key Skills

Education

Any Graduate