Description

You will design, build, and optimize end-to-end data pipelines within a GCP environment.

Responsibilities

• Build and optimize data pipelines using Dataflow, Dataproc, and Pub/Sub.
• Implement ingestion and transformation workflows using Apache Beam, Apache Spark, and Python.
• Manage data storage and performance using BigQuery, Cloud Storage, and Cloud SQL.
• Enforce data security and access controls using GCP IAM and Cloud Security Command Center.
• Tune systems to ensure low-latency and high-throughput performance.

Required Skills

• 12+ years of overall IT experience with a specialization in data engineering.
• 8+ years of experience designing and maintaining data pipelines in enterprise environments.
• 5+ years of recent GCP experience, specifically within a major U.S. bank or brokerage firm.
• Expertise in GCP services: Dataflow, Dataproc, Pub/Sub, BigQuery, Cloud Storage, and Cloud SQL.
• Proficiency with Apache Beam and Apache Spark frameworks.
• Advanced Python and SQL skills for data manipulation and querying.
• Proven experience implementing GCP IAM policies and managing security at scale.

Key Skills

Education

Any Gradute