Description

You will design and manage data pipelines and infrastructure within the Google Cloud Platform ecosystem.

Responsibilities

• Build and maintain data pipelines using Dataflow, Pub/Sub, and Cloud Composer.
• Manage cloud-native databases including BigQuery, Bigtable, Spanner, Cloud SQL, and AlloyDB.
• Implement CI/CD pipelines for data workloads using Cloud Build, Artifact Registry, and Terraform.
• Execute data governance tasks using Dataplex and Data Catalog.
• Develop streaming solutions using Pub/Sub, Kafka, or equivalent technologies.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python or Java for hands-on programming.
• Deep expertise in GCP Dataflow, Pub/Sub, Cloud Composer, Cloud Workflow, BigQuery, Cloud Run, and Cloud Build.
• Strong knowledge of GCP databases: Bigtable, Spanner, Cloud SQL, and AlloyDB.
• Solid understanding of relational database concepts including SQL, MySQL, PostgreSQL, or Oracle.
• Experience with Big Data/Hadoop ecosystems such as Cloudera, Hortonworks, MapR, Kafka, Hive, or Spark.
• Experience with file formats including Avro, ORC, and Parquet.

Preferred Skills

• GCP Data Engineering Certification.
• Experience with NoSQL databases like MongoDB, Scylla, Cassandra, DynamoDB, or HBase.

Key Skills

Education

Any Graduate