Description

You will lead and design data engineering solutions on Google Cloud Platform.

Responsibilities

• Design and develop the ETL/ELT framework using BigQuery concepts like Clustering and Partitioning.
• Manage the end-to-end Data Engineering lifecycle, including non-functional requirements and operations.
• Develop and automate data loads from BigQuery using APIs or scripting.
• Implement Data Integration, Data Transformation, Data Quality, and Data Lineage processes.
• Own E2E solution design, including prototyping and data visualization literacy.

Required Skills

• 10+ years of professional experience in Data Engineering or Architect roles.
• Deep, hands-on experience with Google BigQuery (GBQ) and Google Cloud Platform (GCP).
• Expert proficiency in Python, PySpark, and Pandas.
• Experience building data pipelines using Google Data Products (Dataflow, Dataproc, Cloud Composer/Airflow).
• Strong command of Big Data technologies: Spark, Hadoop, Hive, and MapReduce.
• Expertise in SQL and experience with NoSQL modern data stores.
• Experience creating DAGs and configuring Airflow environments.

Key Skills

Education

Any Graduate