Description

You will architect enterprise-scale distributed data platforms and lead cloud migration initiatives.

This role is on-site.

Responsibilities

• Build high-performance data pipelines using PySpark.
• Design Data Lakehouse solutions leveraging Apache Iceberg.
• Develop federated query architectures with Trino (Presto).
• Mentor engineering teams and drive technical best practices.
• Partner with customers, architects, and business stakeholders.

Required Skills

• 5+ years of experience with PySpark and Spark SQL.
• Deep expertise in Apache Iceberg and Data Lakehouse Architecture.
• Proficiency with Trino or Presto for federated queries.
• Strong background in AWS, Azure, or GCP cloud platforms.
• Experience with Airflow for orchestration.
• Knowledge of Parquet, ORC, or Avro file formats.
• Solid SQL and data modeling skills.
• Hands-on experience with CI/CD, Git, and DevOps practices.

Preferred Skills

• Enterprise architecture experience.
• Customer-facing consulting or solution design background.
• Exposure to AI/ML and analytics platforms.

Key Skills

Education

Bachelor's degree