Description

You will design, develop, and maintain data pipelines using Java and Apache Iceberg.

Responsibilities

• Design, develop, and maintain data pipelines using Java and Apache Iceberg.
• Implement Iceberg table schemas and partitioning strategies.
• Architect Iceberg catalog layers.

Required Skills

• 7+ years of experience in Java development, with at least 1 year focusing on Apache Iceberg.
• Deep understanding of core Java concepts, OOP, libraries, and frameworks.
• Strong understanding of Iceberg architecture, features (schema evolution, hidden partitioning, time travel, ACID transactions), and best practices.
• Experience with Iceberg table creation, data ingestion, querying, and working with Iceberg's lava API.
• Experience with Apache Spark.
• Experience with cloud storage solutions like AWS S3.
• Strong knowledge of SQL and experience with relational databases.
• Proficiency with Git.

Key Skills

Education

Not specified