Description

You will design, build, and maintain batch and streaming data pipelines on Google Cloud Platform.

This role is remote.

Responsibilities

• Build and optimize BigQuery datasets, tables, views, and complex SQL queries.
• Develop data pipelines using Dataflow (Apache Beam), Pub/Sub, and Cloud Storage.
• Automate and schedule workflows using Cloud Composer (Airflow).
• Implement data ingestion from APIs, databases, and flat files.
• Ensure data accuracy, consistency, monitoring, and robust error handling.

Required Skills

• 5+ years of experience as a Big Data Engineer.
• Strong hands-on experience with Google Cloud Platform data services: BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
• Proficiency in writing and optimizing complex SQL queries in BigQuery.
• Experience with batch and streaming data processing architectures.
• Hands-on experience ingesting data from APIs, databases, and flat files.
• Proficiency with Cloud Composer (Airflow) for workflow orchestration.
• Understanding of IAM, security controls, and compliance standards in cloud environments.
• Ability to collaborate effectively with cross-functional teams.

Key Skills

Education

Any Graduate