Description

You will design, build, and maintain large-scale distributed data systems and cloud-based solutions on Google Cloud Platform.

This role is on-site.

Responsibilities

• Design and maintain data processing systems using Google Cloud Platform.
• Manage real-time and batch data integration processes using Dataflow.
• Query and analyze large-scale datasets using BigQuery.
• Develop data processing scripts and automation using Python.
• Interface with REST and GraphQL APIs to synchronize data across systems.

Required Skills

• 5+ years of experience as a software engineer or in a similar role focused on distributed systems or high-traffic applications.
• 2+ years of strong Python coding experience for data processing and automation.
• Proficiency in SQL with experience writing efficient, performant queries.
• Hands-on experience with Google Cloud Platform (GCP), specifically BigQuery and Dataflow.
• Experience with pipeline orchestration tools like Apache Airflow.
• Familiarity with Kafka for data streaming and messaging.
• Experience with version control systems, specifically Git.

Preferred Skills

• Experience with big data tools such as Spark or PySpark.
• Familiarity with MLOps tooling like MLFlow.
• Experience with Infrastructure as Code (IaC) frameworks, particularly Terraform.

Key Skills

Education

Any Graduate