Description

You will design, develop, and maintain scalable data solutions within a data lakehouse architecture, focusing on Apache Iceberg, Oracle, and Starburst.

This role is remote.

Responsibilities

• Design and optimize data ingestion, transformation, and curation processes using PySpark and ETL/ELT pipelines.
• Develop and manage Apache Iceberg tables for open table format management within the data lakehouse.
• Utilize Starburst for high-performance querying and data virtualization across Iceberg and Oracle sources.
• Work extensively with Oracle databases for schema design, stored procedures, and performance tuning.
• Collaborate with data architects and business intelligence teams to translate requirements into technical data models.

Required Skills

• 5+ years of experience in applications development or data engineering.
• Strong proficiency in Apache Iceberg, Oracle, and Starburst.
• Experience with PySpark, ETL/ELT, and building data pipelines.
• Expertise in SQL, database development, and performance tuning.
• Knowledge of data modeling and big data technologies.
• Bachelor's degree or equivalent experience.

Preferred Skills

• Experience in the Financial Services industry.
• Knowledge of Trino, Data Warehousing, and data governance standards.
• Familiarity with S3, ADLS, and distributed data processing.

Key Skills

Education

Any Graduate