Description

You will design, build, and maintain large-scale data warehousing solutions and pipelines on Google Cloud Platform.

This role is on-site.

Responsibilities

• Design logical and physical data models for big data platforms and RDBMS.
• Build and manage data pipelines using Apache Hive, Spark, Scala, and Kafka.
• Automate workflows and orchestrate ETL processes using Apache Airflow.
• Lead design reviews, backlog grooming, and daily standups using JIRA.
• Mentor junior engineers and serve as the primary technical contact for assigned business domains.

Required Skills

• 8+ years of experience in SQL, Spark, Scala, and Hive.
• 8+ years of experience with ETL processes and data management.
• 5+ years of experience with GCP, specifically GCS, Dataproc, and BigQuery.
• 4+ years developing distributed data processing platforms using Hadoop, Hive, Scala, or Airflow.
• 2+ years of data modeling experience using Erwin for data lakes or RDBMS.
• Proficiency in Python, Java, Scala, Perl, or Shell scripting.
• Experience managing large-scale datasets at the multi-TB or PB scale.
• Background in Scrum/Agile development and test-driven development.
• Bachelor's degree in Computer Science or equivalent experience.

Preferred Skills

• Experience with Gitflow and Atlassian products including BitBucket, JIRA, and Confluence.
• Experience with CI tools such as Bamboo, Jenkins, or TFS.

Key Skills

Education

ANY GRADUATE