Description

You will design, build, and migrate production data pipelines on Google Cloud Platform.

This role is on-site.

Responsibilities

• Lead technical discovery to map business requirements to target state architectures.
• Design and execute data and pipeline migrations from legacy systems (Hadoop, Exadata, Oracle, Teradata, Netezza) to GCP.
• Build end-to-end data pipelines from ingestion to consumption within hybrid big data architectures.
• Establish architecture guidelines, best practices, and technical blueprints for GCP environments.

Required Skills

• 5+ years building production data pipelines.
• Expertise in Python, Scala, or Java.
• Deep knowledge of GCP services: BigQuery, Cloud Storage, Bigtable, Dataflow, Dataproc, Cloud Composer, Cloud Pub/Sub, and Data Fusion.
• Hands-on experience with Airflow, WireSafe, and GCP Data Transfer tools.
• Proficiency in PySpark, Structured Streaming, and Batch processing.
• Experience with Hadoop, Hive, HDFS, HBase, and Spark.
• Working knowledge of GCP CI/CD and SDK.
• Background in ETL build and design for data lakes and data warehouses.

Preferred Skills

• Basic understanding of Java.

Key Skills

Education

Any Graduate