Description

You will build and maintain large-scale data processing pipelines and distributed query systems. Your work focuses on optimizing storage formats and managing complex data lake architectures.

Responsibilities

• Execute complex queries using Trino, Presto, or Starburst.
• Process large datasets using Apache Spark and Hive.
• Manage and optimize data storage formats including JSON and Parquet.
• Implement data lake architectures using modern storage protocols.

Required Skills

• 5+ years of experience in data science or data engineering.
• Proficiency with Trino (including Presto and Starburst).
• Hands-on experience with Apache Spark.
• Expertise with Hive.
• Experience with JSON and Parquet data formats.
• Degree in any graduate field.

Preferred Skills

• Experience with Avro, Delta Lake, or Iceberg.

Key Skills

Education

Any Graduate