Description

You will build and maintain data processing workflows using Spark and Scala.

Responsibilities

• Develop and manage ETL workflows to process large datasets.
• Build and maintain data components using Spark and Scala.
• Manage deployment processes and components using uDeploy.
• Maintain version control and CI/CD pipelines using Bitbucket and Git.
• Operate within an Agile environment using JIRA for task tracking.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency with Spark and Scala.
• Strong experience with Python.
• Hands-on work with Hadoop ecosystems.
• Experience with SQL and PL/SQL.
• Experience with NoSQL databases, specifically MongoDB.
• Knowledge of ETL workflow development.
• Experience with Git and Bitbucket.
• Familiarity with CI/CD pipelines and uDeploy.

Preferred Skills

• Experience working in Agile methodologies.
• Proficiency using JIRA.

Key Skills

Education

Any Gradute