Description

You will build and manage data pipelines for the Customer Experience click stream team, owning the end-to-end delivery of technical specifications and team workflows.

Responsibilities

• Set up and manage databases and dimensional models using Azure Synapse.
• Translate product requirements into technical specifications for the engineering team.
• Develop and optimize data ingestion and transformation processes using PySpark.
• Manage team workflows and deliver technical presentations to stakeholders.

Required Skills

• 5+ years of experience in data engineering roles.
• Expertise in SQL, T-SQL, and SQL stored procedures.
• Proficiency in Python and PySpark for data transformation.
• Experience with Azure Synapse and Azure Data Lake Storage.
• Hands-on work with Azure Data Factory and Azure Databricks.
• Experience managing infrastructure via Terraform and Azure DevOps.
• Knowledge of GitHub and GitHub Actions.
• Ability to work with Avro, JSON, and CSV file formats.
• Proven experience managing a team and leading technical projects.

Preferred Skills

• Direct experience working with click stream data.
• Familiarity with Azure Functions and Azure Log Analytics.

Key Skills

Education

Any Graduate