Description

You will build and maintain data processing systems using Spark and Scala.

This role is remote.

Responsibilities

• Build and manage ETL workflows to process large datasets.
• Develop data pipelines using Spark, Scala, and Python.
• Manage data storage and retrieval across PL/SQL and NoSQL databases.
• Maintain deployment processes and CI/CD pipelines.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency with Spark and Scala.
• Experience with Python.
• Strong knowledge of Hadoop ecosystems.
• Hands-on experience with PL/SQL and NoSQL databases, specifically MongoDB.
• Experience designing and implementing ETL workflows.
• Proficiency with Git and Bitbucket for version control.

Preferred Skills

• Experience managing CI/CD pipelines.

Key Skills

Education

Any Gradute