Description

You will build and optimize data processing, orchestration, and monitoring systems using open-source software, AWS, and GitLab automation.

Responsibilities

• Develop and enhance data-processing and orchestration workflows.
• Collaborate with product and technology teams to design and validate data platform capabilities.
• Automate manual processes and redesign systems for improved usability and scalability.
• Provide technical support and usage guidance to platform service users.
• Implement metrics, monitoring, and alerting mechanisms for production services.

Required Skills

• 4+ years of advanced working knowledge of SQL, Python, and PySpark.
• 2+ years of experience with AWS technologies.
• Experience building and optimizing data pipelines in distributed environments.
• Proficiency working in Linux environments.
• Experience with Git/Bitbucket, Jenkins/Code Build, and Code Pipeline.
• Experience using platform monitoring and alerting tools.
• Proven ability to support and work with cross-functional teams.
• 13+ years of professional experience.

Key Skills

Education

Any Graduate