Description

You will design, develop, and maintain scalable data pipelines on Google Cloud Platform to ensure seamless data availability and accessibility.

This role is on-site.

Responsibilities

• Build and optimize ETL/ELT processes using Apache Airflow for data extraction, transformation, and loading.
• Develop data manipulation and engineering tasks using Python and PySpark.
• Manage data warehousing solutions in BigQuery, ensuring consistency, reliability, and accuracy.
• Implement data validation, quality checks, and monitoring to maintain data integrity across the lifecycle.
• Troubleshoot data pipelines and infrastructure to ensure high availability and performance.

Required Skills

• 6+ years of experience as a Data Engineer.
• Expertise in GCP data services, specifically BigQuery and Dataproc.
• Strong hands-on experience with Python and PySpark.
• Proficiency in SQL and NoSQL databases, including MySQL, with strong query optimization skills.
• Experience designing and maintaining ETL workflows using Apache Airflow.
• Understanding of data modeling concepts and scalable data architecture.
• Knowledge of DevOps concepts within GCP environments.
• Experience with Git for version control and collaboration.

Preferred Skills

• Experience with Talend or Informatica.
• Knowledge of data governance, security best practices, and cost management strategies.

Key Skills

Education

Any Graduate