Description

You will design, develop, and implement cloud-based data engineering solutions and major system enhancements on Google Cloud Platform.

Responsibilities

• Design and implement data engineering solutions using Google Cloud Storage, BigQuery, and Cloud SQL.
• Lead feasibility studies and business systems analysis for major projects.
• Perform data preprocessing and feature engineering using Cloud Dataflow and BigQuery.
• Provide production support for complex systems, troubleshooting issues and optimizing performance.
• Utilize Apache Spark, Hadoop, and Hive to drive system functionality.

Required Skills

• 7+ years of experience in cloud engineering environments.
• Extensive experience with Google Cloud Platform (GCP) and its APIs/SDKs.
• Proficiency with Google Cloud Storage, Cloud Functions, Pub/Sub, Cloud Scheduler, Cloud Run, BigQuery, and Cloud SQL.
• Hands-on experience with Apache Spark, PySpark, Hadoop, and Hive.
• 5-7+ years of Terraform development experience.
• Strong SQL skills and expertise in data modeling and database design.
• Foundational knowledge of cloud computing concepts including virtual machines, storage, and networking.
• Bachelor's degree or equivalent professional experience.

Preferred Skills

• Experience writing Python scripts for data engineering using NumPy, Pandas, and SciPy.
• Background working in the healthcare or insurance industry.

Key Skills

Education

Bachelor's degree