Description
Design, develop, and maintain scalable data pipelines and workflows on Google Cloud Platform.
This role is on-site.
Responsibilities
- Build and optimize data models, schemas, and warehouses using BigQuery and Cloud SQL.
- Develop scalable data pipelines using Dataflow, Dataproc, and Cloud Data Fusion.
- Automate data workflows, monitor system health, and troubleshoot issues proactively.
- Ensure data quality, security, and compliance across all data environments.
- Collaborate with stakeholders to gather requirements and deliver effective data solutions.
Required Skills
- 5+ years of experience in data engineering or data architecture.
- Proficiency in SQL and programming languages: Python, Java, or Scala.
- Hands-on experience with GCP services: BigQuery, Cloud SQL, Cloud Storage, Dataflow, Dataproc, Data Fusion.
- Experience designing and implementing scalable and secure data pipelines on GCP.
- Knowledge of ETL/ELT processes, data modeling, and data warehousing concepts.
- Familiarity with containerization (Docker) and orchestration (GKE, Kubernetes).
- Understanding of data security, encryption, and compliance policies.
- Experience with Apache Spark, Kafka, or Pub/Sub for real-time data streaming.
Preferred Skills
- Experience with Terraform, Deployment Manager, and CI/CD integrations.
- Familiarity with machine learning workflows on GCP (Vertex AI, AI Platform).
- Knowledge of Cloud IAM and cybersecurity best practices.