Description

You will design, develop, and maintain scalable data pipelines and backend systems.

This role is hybrid.

Responsibilities

• Design and maintain data pipelines using Spark, Python, Scala, and Java.
• Write optimized SQL queries for ETL processes and work with DataFrame operations.
• Implement data storage and processing solutions using AWS or GCP.
• Build and maintain real-time streaming pipelines using MSK/Kafka.

Required Skills

• 5+ years of experience in backend development focused on data engineering.
• Strong proficiency in Spark, Python, Scala, and Java.
• Expertise in SQL and relational database interaction.
• Experience with cloud technologies, specifically AWS or GCP.
• Experience with message streaming platforms like MSK/Kafka.
• Experience utilizing S3 or similar object storage solutions.
• Familiarity with data lake technologies such as Iceberg.

Key Skills

Education

Any Graduate