Description

You will manage data infrastructure and ensure the reliability of data-intensive applications on Google Cloud Platform.

Responsibilities

• Manage data infrastructure and implement SRE practices to ensure system stability.
• Maintain and optimize GCP data services including BigQuery, Dataflow, Data Fusion, Dataproc, Cloud Composer, Pub/Sub, and Google Cloud Storage.
• Implement data governance using Dataplex, ensuring security and compliance best practices.
• Execute data quality assurance and testing protocols within the GCP environment.
• Develop automation scripts and manage CI/CD pipelines for data workflows.

Required Skills

• 10+ years of experience in Data Site Reliability Engineering or similar infrastructure roles.
• Proficiency with Google Cloud Platform (GCP) and related data services.
• Strong programming skills in Python (numpy, pandas, pyspark), Java (Core Java, Spark with Java, functional interface, lambda, java collections), or Scala.
• Hands-on experience with big data platforms including Hadoop and Spark.
• Experience with data streaming technologies such as Kafka.
• Knowledge of relational databases and data warehousing.
• Experience with cloud services including AWS and Azure.
• Proficiency with version control using Git.

Preferred Skills

• Experience with containerization and orchestration using Docker and Kubernetes.

Key Skills

Education

Any Graduate