Description

Job Responsibilities include:

Design, develop, and optimize large-scale data processing applications using Apache Spark and Scala.

Build and maintain scalable data pipelines, data ingestion frameworks, and data management solutions for enterprise data platforms.

Collaborate with stakeholders to analyze data requirements, data transformations, and business analytics needs.

Monitor, troubleshoot, and resolve complex performance and reliability issues across distributed data systems.

Lead engineering execution by driving roadmap reviews, status reporting, project delivery, and technical best practices.

Work with AWS/S3, Iceberg, SQL, Git, and cloud-based data technologies to ensure efficient, high-performance data processing solutions.

Required Qualifications:

Bachelor’s degree in computer science, Information Technology, Data Engineering, Mathematics, or a related field.

6-8 years of experience in Big Data engineering, distributed systems, and large-scale data platform development.

Strong hands-on experience with Apache Spark, Scala, Spark DataFrame APIs, SQL, and data modeling.

Experience building and managing large-scale data platforms using AWS/S3, Iceberg, Git, and distributed data processing technologies

Key Skills

Education

Any Graduate