Description

You will manage and develop data engineering solutions within the Google Cloud Platform environment.

Responsibilities

• Build and maintain data pipelines using Apache Spark, PySpark, Hadoop, and Hive.
• Develop infrastructure as code using Terraform.
• Design and implement data models and database schemas.
• Utilize GCP services including BigQuery, Cloud SQL, Cloud Run, and Cloud Storage to manage data workflows.
• Configure cloud-based services such as Pub/Sub, Cloud Functions, and Cloud Scheduler.

Required Skills

• 5+ years of experience in data engineering or cloud environments.
• Proficiency with Google Cloud Platform (GCP) services and APIs.
• Hands-on experience with Terraform development.
• Strong expertise in SQL and database modeling.
• Experience with Apache Spark, PySpark, Hadoop, and Hive.
• Practical knowledge of BigQuery, Cloud SQL, and Cloud Run.
• Understanding of cloud computing fundamentals including virtual machines, storage, and networking.
• Ability to work with GCP SDKs.

Preferred Skills

• Experience writing Python scripts for data engineering using NumPy, Pandas, or SciPy.
• Background working in the healthcare or insurance industry.

Key Skills

Education

Any Graduate