Description

You will own the design, development, and maintenance of data pipelines and back-end systems.

Responsibilities

• Design and develop data pipelines using Spark, Python, Scala, and Java.
• Write optimized SQL queries for ETL processes across large datasets.
• Implement data storage and processing solutions leveraging AWS or GCP.
• Build and maintain real-time data streaming pipelines using Kafka or MSK.
• Ensure data quality, integrity, and security across all systems.

Required Skills

• 5+ years of experience in back-end development focused on Data Engineering.
• Strong proficiency in Spark, Python, Scala, and Java.
• Expertise in SQL and relational database interaction.
• Experience with cloud technologies, specifically AWS or GCP.
• Hands-on experience with message streaming platforms like Kafka or MSK.
• Familiarity with object storage solutions like S3.
• Experience using data lake technologies such as Iceberg.
• Solid understanding of data warehousing concepts.
• Experience with CI/CD Pipelines.

Key Skills

Education

Bachelor's degree