Description

You will build and maintain data engineering solutions on Google Cloud Platform.

This role is remote.

Responsibilities

• Build and maintain data pipelines using Apache Spark, PySpark, Hadoop, and Hive.
• Develop infrastructure as code using Terraform.
• Design and implement data models and database schemas.
• Utilize GCP services including BigQuery, Cloud SQL, Cloud Run, and Cloud Storage.
• Configure cloud-based services such as Pub/Sub, Cloud Functions, and Cloud Scheduler.

Required Skills

• 5+ years of experience in data engineering or cloud environments.
• Proficiency with Google Cloud Platform (GCP) services and APIs.
• Hands-on experience with Terraform development.
• Strong expertise in SQL and database modeling.
• Experience with Apache Spark, PySpark, Hadoop, and Hive.
• Practical knowledge of BigQuery, Cloud SQL, and Cloud Run.
• Understanding of cloud computing fundamentals including virtual machines, storage, and networking.
• Ability to work with GCP SDKs.

Preferred Skills

• Experience writing Python scripts for data engineering using NumPy, Pandas, or SciPy.
• Background working in the healthcare or insurance industry.

Key Skills

Education

Any Graduate