Description
You will design and deliver data pipelines and integration workflows within a Google Cloud environment.
Responsibilities
- Build and maintain ETL processes, data warehousing, and database management systems.
- Develop data pipelines using Dataflow, DataStream, and Spark to integrate disparate systems.
- Implement serverless architectures using Google Cloud Functions and Google Cloud Run.
- Manage real-time data streams using Google Pub/Sub.
- Apply data modeling concepts to structure complex datasets for analysis.
Required Skills
- 9+ years of total IT experience.
- 5+ years of experience in data engineering, data analysis, or ETL roles.
- Strong proficiency in SQL with direct hands-on experience.
- Extensive experience with Google BigQuery.
- Experience with Spark, Dataflow, and DataStream.
- Experience with Google Cloud Functions, Google Cloud Run, and Google Pub/Sub.
- Proficiency in data modeling and using data modeling tools.
- Experience with data exploration tools such as KNIME or Alteryx.
- Bachelor's degree or equivalent graduate-level education.