Description

You will design, implement, and maintain scalable data architectures, including databases, AWS data lakes, and data warehouses.

Responsibilities

• Build and optimize ETL processes to move data from diverse sources into unified gold datasources for analysis.
• Manage and optimize data infrastructure, including storage, processing, and retrieval systems, to ensure efficiency and cost-effectiveness.
• Develop and maintain automated code for data processing tasks using Python, Spark, and SQL.
• Ensure data consistency, accuracy, and quality throughout the entire data lifecycle.
• Collaborate with business stakeholders to gather requirements and document data processes, pipelines, and architectures.

Required Skills

• 5+ years of experience as a Senior Data Engineer or in a similar role.
• Proven experience in Data Platform Management.
• Hands-on experience with AWS services including S3, Athena, Glue, and Redshift.
• Experience working with Databricks, preferably on AWS.
• Strong programming skills in Python, Spark, and SQL.
• Experience with data processing technologies.
• Knowledge of Agile processes such as Scrum and Kanban.
• Knowledge of Dataiku.
• Knowledge of Azure DevOps.

Preferred Skills

• Experience aligning data architectures with existing enterprise tools and frameworks.

Key Skills

Education

Any Graduate