Description

You will build and maintain the core data infrastructure, ensuring scalability and reliability across distributed systems.

This role is on-site.

Responsibilities

• Develop and enhance data-processing, orchestration, and monitoring pipelines using open-source software, AWS, and GitLab automation.
• Collaborate with product and technology teams to design, validate, and implement data platform capabilities.
• Drive process improvements by automating manual tasks and optimizing workflows for scalability.
• Provide technical support and usage guidance for platform services to internal stakeholders.
• Drive the creation and refinement of metrics, monitoring, and alerting systems for production service visibility.

Required Skills

• 15+ years of experience building and optimizing data pipelines in a distributed environment.
• Proficiency in Linux environments and strong knowledge of Data Structures.
• Working knowledge of SQL, Python, and PySpark.
• Experience with version control and CI/CD tools: Git/Bitbucket, Jenkins, CodeBuild, and CodePipeline.
• Familiarity with GitLab and AWS cloud services.
• Proven ability to work effectively with cross-functional teams.

Preferred Skills

• Bachelor's degree in Computer Science, Engineering, or related field.
• Experience with large-scale data architecture and optimization.

Key Skills

Education

Any Gradute