Description

You will design, develop, and maintain scalable data pipelines and backend systems using Spark, Python, Scala, and Java.

This role is on-site.

Responsibilities

• Build and optimize data pipelines using Spark, Python, Scala, and Java.
• Write efficient SQL queries for ETL processes and work with DataFrames to analyze large datasets.
• Implement real-time data streaming pipelines using MSK/Kafka and manage storage with S3.
• Ensure data quality, integrity, and security while troubleshooting pipeline issues.
• Collaborate with data scientists and engineers to deliver data-driven solutions.

Required Skills

• 5+ years of backend development experience with a focus on data engineering.
• Strong proficiency in Spark, Python, Scala, and Java.
• Expertise in SQL and relational databases.
• Experience with cloud technologies, preferably AWS or GCP.
• Hands-on experience with message streaming platforms like MSK/Kafka.
• Experience with object storage (S3) and data lake technologies like Iceberg.
• Solid understanding of data warehousing concepts.

Preferred Skills

• Experience with data modeling, schema design, and data governance.
• Familiarity with DevOps practices and CI/CD pipelines.

Key Skills

Education

Any Graduate