Description

You will build and maintain data pipelines within the Google Cloud Platform ecosystem. You own the development of data processing workflows and the optimization of large-scale storage systems.

Responsibilities

• Develop data processing workflows using Spark SQL and Spark Streaming.
• Manage and optimize large-scale data storage and processing using Hadoop.
• Implement data ingestion and transformation logic within GCP.
• Maintain data integrity and performance across distributed systems.

Required Skills

• 9+ years of experience in data engineering roles.
• Strong proficiency in Spark SQL and Spark Streaming.
• Extensive experience with Hadoop ecosystems.
• Hands-on experience with Google Cloud Platform (GCP).
• Proficiency in SQL.
• Degree in any graduate field.

Preferred Skills

• Working experience in Java or Python.
• Experience with Elasticsearch and Cassandra.

Key Skills

Education

Any Graduate