Description

Lead data engineering efforts on GCP, focusing on automation, administration, and Talend pipeline design.

Responsibilities

• Provide technical guidance to the data engineering team for Talend pipeline design and enhancements.
• Design and implement Talend data pipelines using event, messaging, and streaming patterns.
• Manage GCP administration tasks including project setup, user authorizations, access control, and job scheduling.
• Perform Talend server builds, version upgrades, maintenance, and migrations.
• Troubleshoot environment, software, and application-level issues to support production stability.

Required Skills

• 8+ years of professional experience in data engineering or related roles.
• Expertise in Talend products including Talend Studio, Talend Administration Centre, Big Data, and Data Quality.
• Hands-on experience with GCP services: Cloud Dataflow, Cloud Pub/Sub, BigQuery, Cloud Storage, and Google Cloud Composer.
• Strong ETL experience covering data migration and data consolidation.
• Proficiency with Kafka, API integration, and streaming data patterns.
• Advanced SQL knowledge and experience with Oracle PL/SQL programming.
• Mastery of at least one cloud platform (AWS, Azure, or GCP).
• Experience with Git workflows and SaaS tools such as GitHub, GitLab, or Bitbucket.
• Proficiency in Unix Shell scripting.

Preferred Skills

• Python scripting for task automation.
• Experience with CI/CD, infrastructure provisioning, and automated deployment pipelines.
• Familiarity with data governance processes including security, lineage, and cataloging.

Key Skills

Education

Any Graduate