Description

You design, build, and maintain scalable data pipelines on Google Cloud Platform to support enterprise analytics and reporting.

This role is on-site.

Responsibilities

• Design and implement resilient data pipelines using BigQuery, Dataflow, Cloud Storage, and Pub/Sub.
• Develop distributed data processing workflows using Apache Spark and Python.
• Orchestrate data workflows and automate infrastructure using Apache Airflow, Jenkins, and Terraform.
• Ensure data quality, security, and governance standards across relational and NoSQL databases.
• Troubleshoot pipeline issues and optimize ingestion and transformation for performance and cost.

Required Skills

• 6+ years of experience in data engineering with a focus on GCP.
• Strong proficiency in Python for scripting, automation, and orchestration.
• Hands-on expertise with BigQuery, Dataflow, Cloud Storage, and Pub/Sub.
• Experience with Apache Spark for distributed data processing.
• Proficiency in SQL and managing PostgreSQL, MySQL, or MongoDB.
• Familiarity with containerization (Docker, Kubernetes) and CI/CD tools like Jenkins.
• Knowledge of Linux/Unix environments and Git version control.

Preferred Skills

• Experience with data governance, metadata management, and security best practices (GDPR/HIPAA).
• Familiarity with Apache Airflow or Prefect for orchestration.

Key Skills

Education

Bachelor's or Master's degrees