Description

You will build and manage data pipelines and distributed data platforms on Google Cloud Platform.

Responsibilities

• Design and implement database definitions, schemas, and data lake architectures.
• Develop data processing workflows using DataProc and Dataflow.
• Build and maintain streaming pipelines using Pub/Sub and Kafka.
• Manage data warehouse modeling and Looker views.
• Maintain CI/CD pipelines for data engineering workflows.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python, PySpark, and SQL.
• Hands-on experience with GCP services including GCS, BigQuery, DataProc, and Dataflow.
• Experience with distributed computing frameworks like Spark and Hadoop.
• Competency in Scala and shell scripting.
• Knowledge of streaming technologies such as Kafka and Pub/Sub.
• Experience with stored procedures and data warehouse modeling.
• Ability to work with distributed data platforms and data lakes.

Preferred Skills

• Experience with Looker modeling and view creation.

Key Skills

Education

Any Graduate