Description

You will build and manage data pipelines and infrastructure within the Google Cloud Platform ecosystem.

Responsibilities

• Design, develop, and maintain data pipelines using Dataflow, BigQuery, and Pub/Sub.
• Implement and manage BigQuery data warehouse solutions for secure and efficient storage.
• Provision and manage GCP infrastructure using Terraform and Infrastructure as Code best practices.
• Optimize data storage and retrieval processes to improve performance and reduce costs.
• Monitor and troubleshoot pipeline issues to ensure high availability and data integrity.

Required Skills

• 5+ years of experience as a Data Engineer with a focus on GCP services.
• Hands-on proficiency with Dataflow, BigQuery, and Pub/Sub.
• Experience provisioning GCP infrastructure using Terraform.
• Strong proficiency in SQL and Python for data manipulation and analysis.
• Solid understanding of ETL processes and data warehousing concepts.
• Experience with real-time data processing and streaming analytics.
• Degree in any field (Any Graduate).

Preferred Skills

• Google Cloud Professional Data Engineer certification.
• Experience with Cloud Storage, Cloud Functions, or Cloud Composer.
• Familiarity with Docker, Kubernetes, Ansible, or Cloud Deployment Manager.
• Knowledge of data security and governance practices.

Key Skills

Education

Any Graduate