Description

You will design, build, and optimize scalable data pipelines and warehouse solutions across the Azure ecosystem.

This role is remote.

Responsibilities

• Develop and maintain ETL/ELT workflows using Azure Data Factory (ADF) and Azure Databricks for large-scale structured and unstructured data.
• Design and manage enterprise data lakes using Azure Data Lake Storage (ADLS) and Delta Lake, ensuring high availability and performance.
• Build and optimize data warehouse solutions with Azure Synapse Analytics and Azure SQL Database, including dimensional modeling and indexing.
• Implement data governance, security, encryption, and access controls while troubleshooting pipeline issues.
• Collaborate with Data Scientists, Analysts, and Architects to deliver enterprise data solutions and document technical specifications.

Required Skills

• 5+ years of experience with PySpark, Spark SQL, Python, and SQL.
• Hands-on experience designing data pipelines using Azure Data Factory (ADF).
• Proficiency with Azure Data Lake Storage (ADLS) and Delta Lake technologies.
• Strong background in ETL/ELT process design and data ingestion from diverse sources.
• Experience collaborating with Data Scientists, Data Analysts, and Business Intelligence teams.
• Bachelor's degree in a relevant field.

Preferred Skills

• Experience with Azure Synapse Analytics for enterprise data warehousing.
• Knowledge of data modeling, partitioning, and performance optimization strategies.

Key Skills

Education

Bachelor's degree