Description

Design and implement data pipelines and warehouse architectures within cloud environments.

This role is hybrid.

Responsibilities

• Develop and implement ETL jobs for data warehouses using SQL and Python.
• Architect data lake and data warehouse solutions using star schema methodologies.
• Provision data APIs and manage cloud-based storage and functions.
• Automate infrastructure using AWS CloudFormation or Terraform.
• Deploy code using CI/CD pipelines including AWS CodePipeline, CodeBuild, and CodeDeploy.

Required Skills

• 5+ years of experience in data engineering.
• Expertise in SQL and Python for ETL development.
• Proficiency with Spark and big data processing.
• Hands-on experience with AWS tools: Glue, Athena, Redshift, and Kinesis.
• Experience with Azure Analytics and Databricks.
• Working knowledge of S3, Blob, Lambda, and Azure Functions.
• Proficiency with Git, Bitbucket, and Jira.
• Understanding of information security concepts and terminology.
• University degree in Computer Science, Engineering, Mathematics, or a related discipline.

Preferred Skills

• AWS Certified Solutions Architect or AWS Certified Data Analytics Specialty.
• Familiarity with the Gartner ODM framework.

Key Skills

Education

Any Graduate