Description

You will lead data engineering efforts by designing and maintaining scalable pipelines within a scrum environment.

Responsibilities

• Design, develop, document, deploy, and maintain data pipelines.
• Collect, analyze, and profile batch and streaming data sources.
• Lead master data management efforts within your squad.
• Coach and mentor squad members in software craftsmanship and scrum.
• Collaborate with stakeholders to groom ideas into small, testable work items.

Required Skills

• 10+ years of relevant technical experience.
• Proficiency in Python and SQL.
• Experience with MQL.
• Containerization using Docker.
• Kubernetes Engine management.
• Google Cloud Platform tools including BigQuery, Cloud Storage, and PubSub.
• Experience with Secret Manager and Stackdriver.
• Infrastructure and CI/CD experience with Jenkins, Terraform, Terragrunt, and Bitbucket.
• Monitoring expertise with Datadog and OpsGenie.

Preferred Skills

• Familiarity with GCP services: Artifact Registry, Container Registry, Cloud Composer, Cloud Functions, Cloud Run, and Dataproc.
• Experience with MongoDB, NetSuite, Informatica PIM 360, and Linux.

Key Skills

Education

Any Graduate