Description

You will build and maintain the core data infrastructure for our systems.

This role is on-site.

Responsibilities

• Develop and enhance data processing, orchestration, and monitoring using open-source software, AWS, and GitLab automation.
• Design and validate data platform capabilities in collaboration with product and technology teams.
• Identify and implement process improvements, automating manual tasks and redesigning workflows for scale.
• Drive the creation and refinement of metrics, monitoring, and alerting mechanisms for production visibility.
• Provide technical support and usage guidance for platform services.

Required Skills

• 5+ years of experience building and optimizing data pipelines in a distributed environment.
• Advanced working knowledge of SQL, Python, and PySpark.
• Proficiency working in a Linux environment.
• Experience with Git/Bitbucket and Jenkins/CodeBuild/Code Pipeline.
• Experience with AWS and GitLab automation.
• Familiarity with monitoring and alerting tools.
• Knowledge of Palantir.

Key Skills

Education

Any Graduate