Description

Design, develop, and maintain scalable back-end data engineering systems.

This role is hybrid.

Responsibilities

• Build and maintain data pipelines using Spark, Python, Scala, and Java.
• Write optimized SQL queries for ETL processes and ensure data quality.
• Implement data storage and processing solutions on AWS or GCP.
• Develop real-time streaming pipelines using MSK/Kafka.
• Manage large datasets using DataFrame operations and object storage like S3.

Required Skills

• 5+ years of back-end development experience with a focus on data engineering.
• Strong proficiency in Spark, Python, Scala, and Java.
• Expertise in SQL and relational databases.
• Experience with cloud technologies, specifically AWS or GCP.
• Hands-on experience with message streaming platforms like MSK/Kafka.
• Familiarity with data lake technologies such as Iceberg.
• Knowledge of CI/CD pipelines.

Preferred Skills

• Solid understanding of data warehousing concepts.

Key Skills

Education

Any Graduate