Description

You will design, develop, and maintain scalable back-end systems focused on data engineering.

Responsibilities

• Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
• Write efficient and optimized SQL queries for ETL processes.
• Manipulate and analyze large datasets using DataFrame operations.
• Implement data storage and processing solutions leveraging cloud technologies (AWS or GCP).
• Build and maintain real-time data streaming pipelines using MSK/Kafka.
• Ensure data quality, integrity, and security across data systems.

Required Skills

• 5+ years of experience in back-end development with a focus on data engineering.
• Strong proficiency in Spark, Python, Scala, and Java.
• Expertise in SQL and working with relational databases.
• Experience with cloud technologies, specifically AWS or GCP.
• Experience with message streaming platforms like MSK/Kafka.
• Familiarity with data lake technologies such as Iceberg.
• Experience with object storage solutions like S3.
• Solid understanding of data warehousing concepts.

Key Skills

Education

Any Graduate