Description

You will develop, test, and deploy technical specifications for a global Data Hub using Spark and Scala.

Responsibilities

• Develop end-to-end ETL processes with Spark/Scala to transfer data to and from the data lake.
• Build and maintain data pipelines and the data hub within a microservices architecture.
• Collaborate with cross-functional and cross-country teams to integrate data from various sources.
• Certify deliveries by designing and performing tests to ensure integration quality.
• Maintain and improve CI/CD pipelines alongside other developers.

Required Skills

• 1+ years of experience in data or software engineering.
• Proficiency in Scala, Python, or Java.
• Experience with Big Data technologies and Spark.
• Knowledge of SQL/HQL and SQL databases.
• Experience with integration solutions using APIs and microservices.
• Familiarity with CI/CD tools including Git, GitHub, and Jenkins.
• Experience working within Agile/Scrum methodologies.
• Practical knowledge of Airflow, ControlM, Hive, Databricks, or Maven.
• English language proficiency at a B2+ level.
• Bachelor's degree in Computer Science or a related field.

Key Skills

Education

Any Graduate