Description

You will build and maintain data pipelines within a GCP environment.

Responsibilities

• Design, develop, and maintain data pipelines using GCP-native tools.
• Build scalable ETL/ELT processes using Apache Airflow (Cloud Composer) and BigQuery.
• Implement real-time and batch data ingestion using Pub/Sub and Cloud Dataflow or alternative tools.
• Develop and manage microservices for data processing using Cloud Run.
• Optimize and monitor data workflows to ensure availability and performance.

Required Skills

• 8+ years of experience in data engineering.
• Strong experience with Google Cloud Platform (GCP) services, including BigQuery, Cloud Pub/Sub, Cloud Composer, and Cloud Run.
• Proficiency in Python and SQL for data transformation and orchestration.
• Experience with version control tools like Git.
• Solid understanding of data warehousing concepts and ETL/ELT best practices.
• Experience building and deploying production-grade data pipelines.

Preferred Skills

• Experience with Dataproc (Apache Spark / Hadoop), Firestore, or Cloud SQL.
• Familiarity with Terraform or Infrastructure as Code (IaC).

Key Skills

Education

Any Gradute