Description

You will lead the implementation and support of edge analytical solutions within a Google Cloud ecosystem.

Responsibilities

• Extract, transform, and load data from multiple sources using Big Data technologies.
• Develop and support data ingestion jobs using GCP services including Apache Spark, Dataproc, Dataflow, BigQuery, and Airflow.
• Modify data extraction pipelines into standardized, repeatable, and reusable approaches.
• Automate manual processes, optimize data delivery, and redesign infrastructure for scalability.
• Apply modern software development practices such as serverless computing, microservices architecture, CI/CD, and infrastructure-as-code.

Required Skills

• 5+ years of experience as a Big Data Engineer.
• 3+ years of experience with Apache Spark, Hive, HDFS, and Beam.
• 3+ years of experience in SQL and Scala or Python.
• 2+ years of experience with cloud technologies such as GCP, AWS, or Azure.
• 2+ years of experience with software build management tools like Maven or Gradle.
• Experience with source code control management systems such as SVN, Git, or GitHub.
• Experience working in Agile environments like Scrum or XP.
• Proficiency with relational databases including SQL Server, Oracle, or MySQL.

Preferred Skills

• Data Engineering using GCP technologies including BigQuery, Dataproc, Dataflow, Composer, and Datastream.
• Experience with Atlassian tooling such as Jira and Confluence.

Key Skills

Education

Bachelor's Degree