Description

You will design, develop, and optimize large-scale data pipelines and analytics infrastructure on Google Cloud Platform.

This role is hybrid.

Responsibilities

• Implement and manage ETL processes using GCP services including BigQuery, Dataflow, and Cloud Composer.
• Develop scalable, maintainable, and reusable data pipelines to support BI and analytics needs.
• Optimize SQL queries and data models for cost efficiency and performance within BigQuery.
• Automate workflow orchestration using Apache Airflow for data operations.
• Integrate Hadoop ecosystem components with GCP services to enhance data processing capabilities.

Required Skills

• 5+ years of professional experience in data engineering.
• Strong proficiency in Python and Scala.
• Experience with GCP BigQuery and GCP DataProc.
• Working knowledge of Apache Airflow and GCP Cloud Composer.
• Familiarity with GCP Storage and GCP DataStream.
• Experience integrating Hadoop ecosystem components.
• Ability to write and optimize complex SQL.

Key Skills

Education

Any Degree Graduation