Description

You will design and manage data pipelines and ETL processes within the Google Cloud Platform.

Responsibilities

• Build and maintain ETL processes to ingest data from remote APIs and various sources.
• Develop data pipelines for streaming data into environments like BigQuery.
• Implement real-time streaming and processing for logs, time series, and unstructured data.
• Collaborate with Operations teams to tune existing and new architectures.
• Align Google Cloud best practices with specific customer analytics requirements.

Required Skills

• 8+ years of experience in Data Analytics and Big Data.
• Strong Python programming skills.
• Extensive experience with Google Cloud products including Cloud BigQuery, GCS, Cloud DataFlow, Cloud Pub/Sub, and Cloud BigTable.
• Hands-on experience with relational databases such as PostgreSQL and MySQL.
• Experience with NoSQL systems including MongoDB.
• Background in managing Hadoop environments.
• Proven ability to implement data pipelines and connect to remote APIs.

Preferred Skills

• Experience migrating Data Warehouses and Big Data projects from on-prem to GCP using DataProc.
• Familiarity with Redis and Cassandra.

Key Skills

Education

Any Gradute