Description

Design and build production data engineering solutions on Google Cloud Platform to deliver pipeline patterns and support enterprise analytics.

This role is on-site.

Responsibilities

• Design and build production data engineering solutions using BigQuery, Dataflow, Pub/Sub, BigTable, Data Fusion, Dataproc, Cloud Composer, Cloud SQL, Compute Engine, Cloud Functions, and App Engine.
• Implement automation for all pipeline parts to minimize labor in development and production, including automated data lineage.
• Work with the data team to analyze data, build models, and integrate massive datasets from multiple sources for data modeling.
• Identify, develop, and evaluate Proof of Concepts, testing and comparing competing solutions to recommend the best approach.
• Integrate GCP Data Catalog with Informatica EDC and document complex systems.

Required Skills

• 5+ years of application development experience.
• 3+ years of experience specifically with Google Cloud Platform (GCP).
• 2+ years of coding skills in Java and Python.
• Experience in GCP-based Big Data deployments (Batch/Real-Time) leveraging BigQuery, BigTable, GCS, PubSub, Data Fusion, Dataflow, Dataproc, and Airflow.
• Minimum 1 year of designing and building production data pipelines from ingestion to consumption within a hybrid big data architecture.
• Hands-on GCP experience with at least 1 solution designed and implemented at production scale.

Preferred Skills

• Experience with Informatica EDC.
• Experience with development ecosystems such as Git, Jenkins, and CI/CD.
• Experience architecting and implementing next-generation data and analytics platforms on GCP cloud.

Key Skills

Education

Any Graduate