Description

You will design, implement, and migrate data for medium to large enterprise data platforms.

This role is on-site.

Responsibilities

• Build and maintain ingestion processes for structured and unstructured data sets.
• Develop data cleansing routines and transformation logic using PySpark.
• Design dimensional models, fact tables, and dimension tables within Azure Synapse.
• Optimize performance for Spark jobs and complex SQL queries on multi-terabyte datasets.
• Translate product requirements into technical specifications for the engineering team.

Required Skills

• 7+ years of hands-on experience in data platform design, configuration, and migration.
• Deep expertise in Azure Synapse and the BI space.
• Advanced SQL, T-SQL, and stored procedure development.
• Proficiency in Python, Spark, and Databricks.
• Experience with Azure Data Factory, Azure Functions, and Azure Data Lake Storage.
• Ability to work with Avro, JSON, and CSV file formats using PySpark.
• Experience with Terraform scripting and DevOps processes.
• Hands-on use of Azure DevOps or GitHub Actions for CI/CD pipelines.
• Strong knowledge of data modeling, logical/physical database design, and data warehousing.

Preferred Skills

• Microsoft Azure certifications.
• Experience with Azure Log Analytics.

Key Skills

Education

Bachelor's degree