Description

You will design, build, and operationalize large-scale enterprise data solutions on Google Cloud Platform.

Responsibilities

• Design and implement production data pipelines from ingestion to consumption within hybrid big data architectures.
• Re-architect and re-platform on-premise data warehouses to GCP cloud platforms.
• Perform detailed assessments of current state data platforms to create transition paths to GCP.
• Implement data engineering, ingestion, and curation functions using GCP native or custom programming.
• Lead design workshops to provide technical tradeoffs and recommendations for client solutions.

Required Skills

• 3+ years designing and building enterprise data solutions using GCP services (Cloud DataProc, Cloud Dataflow, Apache Beam, BigTable, BigQuery, Cloud PubSub, or Cloud Functions).
• 1+ years of experience re-platforming on-premise data warehouses to GCP.
• 1+ years of experience building production data pipelines using Java, Python, or Scala.
• 1+ years of experience implementing data ingestion and curation functions on GCP.
• 1+ years of experience performing data platform assessments and GCP transition planning.
• Hands-on experience with at least one GCP solution implemented at production scale.
• 2+ years of experience writing complex SQL queries and stored procedures.
• Proficiency in Spark and SQL.

Preferred Skills

• Experience architecting data lakes, metadata management, or data governance on GCP.
• Knowledge of CI/CD pipelines such as Concense or Jenkins, and Airflow (DAGs).

Key Skills

Education

Bachelor's degree in Computer Science