Description

You will build and manage data architectures centered around Apache Iceberg and Snowflake on AWS.

Responsibilities

• Build Snowflake external tables against data stored in AWS S3 using Apache Iceberg formats.
• Migrate data between AWS S3 accounts using existing pipelines to populate Iceberg tables.
• Develop configuration-based parsing processes to migrate JSON files into specific Iceberg tables.
• Implement rule-based data routing to ensure JSON files are mapped to the correct Iceberg destination without hard-coded logic.

Required Skills

• 10+ years of professional experience in data engineering.
• Hands-on experience building Snowflake external tables against Apache Iceberg tables on AWS S3.
• Proven experience creating Apache Iceberg tables on AWS S3.
• Expertise in migrating JSON files to Apache Iceberg tables on AWS S3.
• Ability to design configuration-based parsing processes rather than using hard-coded rules for JSON formats.
• Proficiency with AWS S3 and cross-account data migration.
• Deep understanding of Data Lakehouse architecture.
• Strong working knowledge of JSON data structures.

Key Skills

Education

Any Graduate