Description

You will design, develop, and maintain scalable data pipelines and backend systems.

This role is on-site.

Responsibilities

• Design and maintain data pipelines using Spark, Python, Scala, and Java.
• Write optimized SQL queries for ETL processes and manipulate large datasets using DataFrames.
• Implement data storage and processing solutions on AWS or GCP.
• Build and maintain real-time data streaming pipelines using MSK/Kafka.

Required Skills

• 5+ years of backend development experience focused on data engineering.
• Strong proficiency in Spark, Python, Scala, and Java.
• Expertise in SQL and working with relational databases.
• Experience with cloud technologies, specifically AWS or GCP.
• Experience with message streaming platforms like MSK/Kafka.
• Experience with S3 or similar object storage.
• Experience with Data Lake technologies like Iceberg.
• Solid understanding of data warehousing and Data Lake concepts.

Preferred Skills

• Experience with data modelling and schema design.
• Experience with data governance and data quality management.

Key Skills

Education

Any Graduate