Description

You will architect and maintain large-scale data processing systems on Google Cloud Platform, ensuring efficient data ingestion, transformation, and storage for downstream analytics.

This role is remote.

Responsibilities

• Develop and optimize Spark SQL and Spark Streaming jobs for real-time and batch processing.
• Design scalable data pipelines using Hadoop ecosystem components.
• Implement and manage NoSQL solutions using Cassandra and search indexing with Elasticsearch.
• Deploy and monitor cloud-native applications on GCP infrastructure.

Required Skills

• 10+ years of experience in data engineering or backend development.
• Strong proficiency in Google Cloud Platform (GCP) services.
• Expertise in Apache Spark, including Spark SQL and Spark Streaming.
• Hands-on experience with Hadoop distributed computing.
• Proficiency in Java or Python programming languages.
• Experience with Elasticsearch for search and analytics.
• Experience with Apache Cassandra for distributed database management.

Key Skills

Education

Any Graduate