You will lead the design and implementation of end-to-end data integration solutions within the Azure ecosystem.
Responsibilities
- Design and develop ETL/ELT workflows, data ingestion processes, and transformation activities using ADF pipelines.
- Build and optimize data pipelines, data lakes, and data warehouses using Azure Synapse Analytics and Azure Databricks.
- Implement data quality checks, validation, and profiling to maintain data accuracy and integrity.
- Secure sensitive data by implementing access controls and security standards.
- Mentor junior team members and provide technical guidance on ADLS, Databricks, and Synapse Analytics.
- Troubleshoot data integration issues and resolve performance bottlenecks in warehousing solutions.
Required Skills
- 9+ years of experience in data integration and engineering.
- Expertise in Azure Data Factory (ADF).
- Hands-on experience with Azure Synapse Analytics.
- Proficiency with Azure Databricks.
- Deep understanding of Delta Lake architecture, including Delta lakes and Delta tables.
- Experience with Azure Logic Apps.
- Ability to design data models and end-to-end ETL/ELT workflows.
- Experience managing data storage and processing in Azure Synapse.
- Any Graduate degree.