Description

You will design, develop, and maintain scalable data pipelines and backend systems.

This role is on-site.

Responsibilities

• Design and maintain data pipelines using Spark, Python, Scala, and Java.
• Write optimized SQL queries for ETL processes and manage DataFrame structures.
• Implement data storage and processing solutions on AWS or GCP.
• Build real-time streaming pipelines using MSK/Kafka.
• Ensure data quality, integrity, and security across all systems.

Required Skills

• 5+ years of backend development experience focused on data engineering.
• Strong proficiency in Spark, Python, Scala, and Java.
• Expertise in SQL and relational database operations.
• Experience with DataFrame manipulation for large-scale data analysis.
• Hands-on experience with AWS or GCP cloud technologies.
• Familiarity with message streaming platforms like MSK/Kafka.
• Knowledge of object storage (S3) and data lake technologies (Iceberg).
• Solid understanding of data warehousing concepts.

Key Skills

Education

Any Graduate