Description

You will implement and support edge analytical solutions within a Google Cloud ecosystem.

Responsibilities

• Extract, transform, and load data from multiple sources and formats using big data technologies.
• Develop, enhance, and support data ingestion jobs using GCP services including Apache Spark, Dataproc, Dataflow, BigQuery, and Airflow.
• Standardize data extraction pipelines to ensure they are repeatable and reusable with minimal supervision.
• Automate manual processes, optimize data delivery, and redesign infrastructure for scalability.
• Apply modern software development practices including serverless computing, microservices architecture, CI/CD, and infrastructure-as-code.

Required Skills

• 5+ years of experience as a Big Data Engineer.
• 3+ years of experience with Apache Spark, Hive, and HDFS.
• 3+ years of experience in SQL and either Scala or Python.
• 2+ years of experience with cloud technologies such as GCP, AWS, or Azure.
• 2+ years of experience with software build management tools like Maven or Gradle.
• Proficiency in SQL, SQL Server, Oracle, or MySQL.
• Bachelor's degree in Computer Science, Systems Engineering, or equivalent experience.

Preferred Skills

• Hands-on data engineering using BigQuery, Dataproc, Dataflow, Composer, or DataStream.
• Experience with source code control (Git, GitHub, SVN) and Agile methodologies (Scrum, XP).
• Familiarity with Atlassian tooling such as Jira and Confluence.

Key Skills

Education

ANY GRADUATE