Description

You will design, develop, and maintain scalable data pipelines on Google Cloud Platform to transform raw data into actionable insights.

Responsibilities

• Design and build scalable data ingestion, transformation, and storage pipelines on GCP.
• Optimize data storage using BigQuery, Cloud Storage, and Cloud SQL.
• Implement data security and access controls using GCP IAM and Cloud Security Command Center.
• Automate data processing tasks using Python scripting.
• Monitor and troubleshoot pipeline performance using Stackdriver and Cloud Monitoring tools.

Required Skills

• 12+ years of total IT experience.
• 8+ years of experience as a Data Engineer.
• 5+ years of experience working with GCP services including Dataflow, Dataproc, Pub/Sub, GCS, BigQuery, Cloud Storage, and Cloud SQL.
• 4+ years of recent experience working within a US-based major bank or brokerage house.
• Expertise in data manipulation and querying using Python and SQL.
• Hands-on experience with distributed data processing using Apache Beam and Apache Spark.
• Deep understanding of data security and access control principles.

Preferred Skills

• Experience collaborating with data experts, analysts, and product teams in a financial environment.

Key Skills

Education

Any Graduate