Description

You will lead the design, building, and execution of end-to-end data pipelines and applications.

This role is on-site.

Responsibilities

• Design and build end-to-end data pipelines and applications.
• Implement ETL/ELT processes using core data technologies.
• Tune Spark jobs for optimal performance.
• Manage data pipelines and manipulate data using Python and SQL.

Required Skills

• 5+ years of experience in Data Engineering.
• Expert proficiency in Palantir Foundry.
• Strong command of PySpark and Spark.
• Proficiency in Python and SQL for data manipulation.
• Hands-on experience with ETL/ELT patterns.
• Experience building and managing Data Pipelines.
• Familiarity with Big Data tooling.

Preferred Skills

• Experience with CI/CD practices.
• Knowledge of Ontology concepts.

Key Skills

Education

Any Graduate