Description

You will lead the design and implementation of end-to-end data integration solutions within the Azure ecosystem.

Responsibilities

  • Design and develop ETL/ELT workflows, data ingestion processes, and transformation activities using ADF pipelines.
  • Build and optimize data pipelines, data lakes, and data warehouses using Azure Synapse Analytics and Azure Databricks.
  • Implement data quality checks, validation, and profiling to maintain data accuracy and integrity.
  • Secure sensitive data by implementing access controls and security standards.
  • Mentor junior team members and provide technical guidance on ADLS, Databricks, and Synapse Analytics.
  • Troubleshoot data integration issues and resolve performance bottlenecks in warehousing solutions.

Required Skills

  • 9+ years of experience in data integration and engineering.
  • Expertise in Azure Data Factory (ADF).
  • Hands-on experience with Azure Synapse Analytics.
  • Proficiency with Azure Databricks.
  • Deep understanding of Delta Lake architecture, including Delta lakes and Delta tables.
  • Experience with Azure Logic Apps.
  • Ability to design data models and end-to-end ETL/ELT workflows.
  • Experience managing data storage and processing in Azure Synapse.
  • Any Graduate degree.

Education

ANY GRADUATE