Description

You will design and manage large-scale, data-heavy distributed systems and cloud-based data solutions.

Responsibilities

• Design, develop, and maintain data processing systems using Google Cloud Platform.
• Manage data integration processes using Dataflow for real-time and batch processing.
• Query and analyze large-scale datasets using BigQuery.
• Interface with REST and GraphQL APIs to synchronize data across systems.
• Develop data processing scripts and automation using Python.
• Optimize data processing and querying performance for scalability.

Required Skills

• 5+ years of experience as a software engineer or in a similar role focused on distributed systems or high-traffic applications.
• 2+ years of strong Python coding experience for data processing and automation.
• Proficiency in SQL with experience writing efficient, performant queries.
• Hands-on experience with Google Cloud Platform (GCP), specifically BigQuery and Dataflow.
• Experience with pipeline orchestration tools like Apache Airflow.
• Familiarity with Kafka for data streaming and messaging.
• Experience with version control systems, specifically Git.
• Ability to work in a remote software development environment.

Preferred Skills

• Experience with big data tools such as Spark or PySpark.
• Familiarity with MLOps tooling like MLFlow.
• Experience with Infrastructure as Code (IaC) frameworks, particularly Terraform.

Key Skills

Education

Any Graduate