Description

Design and manage large-scale data architectures and big data pipelines within a GCP environment.

Responsibilities

• Build and optimize big data pipelines, architectures, and datasets.
• Develop processes for data transformation, structures, metadata, dependency, and workload management.
• Perform root cause analysis on internal and external data to identify process improvements.
• Support cross-functional teams using agile methodologies.

Required Skills

• 10+ years of application development experience.
• 3+ years of experience with GCP.
• 4+ years of experience with large-scale solutioning and operationalization of data warehouses or data lakes.
• Experience with GCP Big Data deployments (Batch/Real-Time) including BigQuery, Google Cloud Storage, Pub-Sub, Data Fusion, Dataflow, Dataproc, and Cloud Functions.
• Proficiency with relational SQL databases.
• Experience with Hadoop, Spark, and Kafka.
• Background in Big Data and GCP environments.

Preferred Skills

• Proficiency in Python and SQL.

Key Skills

Education

Any Graduate