Description

You will build and maintain data pipelines using big data technologies and cloud infrastructure.

Responsibilities

• Develop data processing workflows using Spark SQL and Spark Streaming.
• Manage and optimize large-scale datasets within Hadoop ecosystems.
• Implement data storage solutions across various cloud environments.
• Maintain data availability and performance across distributed systems.

Required Skills

• 9+ years of experience in data engineering.
• Expertise in Spark SQL and Spark Streaming.
• Deep experience with Hadoop.
• Hands-on experience with at least one major cloud provider: GCP, AWS, or Azure.
• Proficiency in SQL.
• Bachelor's degree or equivalent experience in any field.

Preferred Skills

• Professional experience with Java or Python.
• Working knowledge of Elasticsearch and Cassandra.

Key Skills

Education

Any Graduate