Description

You will design, build, and maintain scalable ETL pipelines on Google Cloud Platform.

This role is on-site.

Responsibilities

• Build and maintain ETL pipelines using Apache Spark and object-oriented scripting languages.
• Manage data processing workflows on GCP using Dataflow and DataProc.
• Develop stored procedures and optimize data warehousing solutions in BigQuery.
• Orchestrate pipeline scheduling and workflow tasks using Cloud Composer and Airflow.
• Maintain and troubleshoot existing data infrastructure and database systems.

Required Skills

• 6+ years of overall experience, including 4+ years specifically in Data Engineering.
• Strong proficiency in Google Cloud Platform (GCP) services.
• Hands-on experience with Apache Spark for data processing.
• Expertise in SQL programming and BigQuery data warehousing.
• Experience with ETL pipeline development and management.
• Proficiency in Cloud Composer and Airflow for orchestration.
• Solid understanding of object-oriented and functional scripting languages.

Preferred Skills

• Experience with GCP Dataflow and DataProc for managed data processing.
• Knowledge of database management systems and pipeline maintenance best practices.

Key Skills

Education

Any Graduate