Description

You will design and build data solutions within the GCP environment.

This role is hybrid.

Responsibilities

• Design and develop solutions using Bigdata tools like MapReduce, Hive, and Spark.
• Build data pipelines to handle high-volume data.
• Design, implement, and manage ETL job execution flows and data ingestion processes.
• Write optimized queries using HQL, SQL, and Spark, and design data transformation jobs.
• Troubleshoot, debug, and upgrade existing ETL job chains while participating in code reviews.

Required Skills

• 5+ years of professional experience as a Data Engineer or similar role.
• Strong proficiency in Object Oriented programming using Python.
• Deep experience with Google Cloud Platform (GCP) and BigQuery.
• Hands-on experience with PySpark and Spark.
• Solid understanding of ETL job design principles and data modeling.
• Knowledge of Unix/Linux and Shell scripting.
• Experience setting up and maintaining CI/CD pipelines using Jenkins.
• Familiarity with Git for source version control.

Key Skills

Education

Any Graduate