Description

You will design, develop, and maintain scalable data pipelines and back-end systems using Spark, Python, Scala, and Java. This role is on-site.

Responsibilities

• Build and optimize ETL processes using efficient SQL queries and DataFrames.
• Implement real-time data streaming pipelines using MSK/Kafka.
• Manage data storage and processing solutions on AWS or GCP, including S3.
• Ensure data quality, integrity, and security across large datasets.
• Collaborate with data scientists and engineers to deliver data-driven solutions.

Required Skills

• 5+ years of experience in back-end development with a focus on data engineering.
• Strong proficiency in Spark, Python, Scala, and Java.
• Expertise in SQL and relational databases.
• Experience with cloud technologies (AWS or GCP).
• Experience with message streaming platforms like MSK/Kafka.
• Experience with S3 or similar object storage.
• Experience with data lake technologies like Iceberg.
• Solid understanding of data warehousing concepts.

Preferred Skills

• Experience with data modeling and schema design.
• Experience with DevOps practices and CI/CD pipelines.

Key Skills

Education

Any Graduate