Description

You will design and implement a cloud-native data processing and API integration system within GCP.

Responsibilities

• Build modular Python applications to process identity data files and APIs for synchronization to target platforms.
• Stage identity metadata in BigQuery using defined schemas and implement change detection logic.
• Design and implement logic to call RESTful APIs to maintain target user repositories, including attributes and roles.
• Orchestrate asynchronous, event-driven workflows using GCP Pub/Sub, Composer, and Cloud Run.
• Deploy and manage services using Terraform, focusing on security, idempotency, and configuration as code.
• Implement logging, retry logic, and automated test coverage to ensure system reliability and traceability.

Required Skills

• 6+ years in backend development or data engineering roles.
• Strong Python engineering for data processing and backend development.
• Advanced experience with GCP services: BigQuery, Cloud Run, Cloud Functions, Cloud Composer, Pub/Sub, Cloud Storage, Secret Manager, and Cloud Scheduler.
• Experience interacting with RESTful APIs, including OAuth2 or token-based authentication.
• Proficiency with Terraform for infrastructure automation.
• Strong SQL skills for data transformation and validation.
• Experience with CI/CD, Docker containers, and Git workflows.
• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or equivalent experience.
• Ability to work with structured metadata, user roles, and directory-style data.

Preferred Skills

• Experience integrating with IAM or identity systems like LDAP or Okta.
• Background in regulated or high-security environments.
• Experience handling large-scale user datasets and hybrid batch/streaming processing.
• GCP Certifications.

Key Skills

Education

Bachelor's or Master's degrees