Description

You will design, deploy, and maintain scalable data pipelines within a scrum-based engineering squad.

This role is on-site.

Responsibilities

• Design, develop, document, and maintain batch and streaming data pipelines.
• Collect, analyze, and profile data sources to ensure quality and reliability.
• Lead master data management efforts within your assigned squad.
• Coach and mentor team members on software craftsmanship and scrum practices.
• Collaborate with stakeholders to groom requirements into small, testable work items.

Required Skills

• 10+ years of relevant technical experience in data engineering.
• Proficiency in Python and SQL.
• Experience with MQL.
• Containerization using Docker.
• Kubernetes Engine management.
• Google Cloud Platform tools including BigQuery, Cloud Storage, and PubSub.
• Experience with Secret Manager and Stackdriver.
• Infrastructure and CI/CD experience with Jenkins, Terraform, Terragrunt, and Bitbucket.
• Monitoring expertise with Datadog and OpsGenie.

Preferred Skills

• Familiarity with GCP services: Artifact Registry, Container Registry, Cloud Composer, Cloud Functions, Cloud Run, and Dataproc.
• Experience with MongoDB, NetSuite, Informatica PIM 360, and Linux.

Key Skills

Education

Any Graduate