Description

You will design, build, and maintain next-generation data lakehouse platforms using Apache Iceberg and Snowflake.

Responsibilities

• Design and implement scalable data lakehouse architectures using Apache Iceberg.
• Build Snowflake external tables referencing Apache Iceberg tables stored on AWS S3.
• Migrate data between AWS S3 accounts into Apache Iceberg tables.
• Develop and maintain ingestion, transformation, and curation pipelines for structured and semi-structured data.
• Implement data catalogs, metadata management, lineage tracking, and role-based access controls.

Required Skills

• 5+ years of experience in data engineering roles.
• Proven experience building Snowflake external tables over Apache Iceberg tables on AWS S3.
• Deep understanding of Iceberg concepts including schema evolution, partitioning, and time travel.
• Proficiency in Python, SQL, and Spark or other distributed data processing frameworks.
• Hands-on experience with AWS services including S3, Glue, Lake Formation, and IAM.
• Experience with data governance tools such as Collibra, Alation, or Informatica.
• Experience implementing metadata, lineage, and data classification standards.
• Bachelor of Computer Science degree.

Preferred Skills

• Experience migrating JSON files to Apache Iceberg tables using configuration-driven rules.
• Familiarity with ETL orchestration tools like Apache Airflow, DBT, or AWS Step Functions.
• Prior exposure to MDM, data quality frameworks, or stewardship platforms.

Key Skills

Education

BACHELOR OF COMPUTER SCIENCE