Description

You will own the design, development, and maintenance of data pipelines on Google Cloud Platform.

Responsibilities

• Design and build scalable ETL/ELT processes using BigQuery and Apache Airflow (Cloud Composer).
• Implement real-time and batch data ingestion workflows using Pub/Sub and Cloud Dataflow or similar tools.
• Develop and manage data processing microservices utilizing Cloud Run.
• Optimize and monitor data workflows to ensure availability and performance.
• Collaborate with data analysts and scientists to meet data integration requirements.

Required Skills

• 8+ years of professional experience in data engineering.
• Strong command of Google Cloud Platform (GCP) services, specifically BigQuery, Cloud Pub/Sub, and Cloud Composer.
• Proficiency in Python and SQL for complex data transformation and orchestration.
• Demonstrated experience building and deploying production-grade data pipelines.
• Solid understanding of data warehousing concepts and ETL/ELT best practices.
• Experience with version control using Git.

Preferred Skills

• Experience with Apache Spark or Hadoop, Firestore, or Cloud SQL.
• Familiarity with CI/CD pipelines and data engineering DevOps practices.

Key Skills

Education

Any Gradute