Description

Build and maintain data processing, orchestration, and monitoring solutions for production environments.

Responsibilities

• Develop and enhance data processing and orchestration solutions using Python, PySpark, and AWS.
• Design and validate data platform capabilities in collaboration with cross-functional teams.
• Automate workflows and optimize systems for scalability to improve processes.
• Implement metrics, monitoring, and alerting solutions to ensure production stability and visibility.
• Provide technical support and establish best practices for platform services.

Required Skills

• 6-8 years of professional experience with Python, PySpark, and SQL.
• Strong proficiency in Data Structures and Algorithms.
• Hands-on experience with Linux environments.
• Experience with Git, Bitbucket, Jenkins, Code Build, or Code Pipeline.
• Practical knowledge of GitLab automation.
• Experience implementing platform monitoring and alerting tools.
• Proven coding skills in a production environment.

Preferred Skills

• Familiarity with Palantir.

Key Skills

Education

Any Gradute