Description

What You'll Do:

• Design and develop scalable data pipelines using Azure Databricks (PySpark)
• Build and maintain robust ETL/ELT workflows for large-scale data processing
• Develop and optimize complex SQL queries in Snowflake for analytics and reporting
• Integrate data pipelines using Azure services such as ADF, ADLS, and Synapse
• Design and manage Snowflake data warehouse structures (tables, views, pipelines)
• Perform performance tuning of Spark jobs and Snowflake workloads
• Implement data quality, validation, governance, and monitoring mechanisms
• Collaborate with business stakeholders to gather requirements and deliver data solutions
• Troubleshoot and resolve data pipeline and production issues

Expertise You'll Bring:

• 8?12 years of experience in Data Engineering
• Strong hands-on experience with Azure Databricks and PySpark
• Extensive experience with Snowflake (data modeling, optimization, ETL/ELT pipelines)
• Strong proficiency in SQL and Python
• Experience with Azure services: Data Factory (ADF), Data Lake (ADLS), Synapse
• Solid understanding of data warehousing, ETL processes, and pipeline architecture
• Experience with version control and CI/CD tools (Git, Azure DevOps)

Key Skills

Education

Any Graduate