Design and implement end-to-end ETL/ELT solutions for data integration and transformation.
Responsibilities
- Build and manage batch and near real-time data ingestion pipelines using Azure services.
- Develop serverless data warehouses and orchestrate workflows using Azure components.
- Implement data extraction, cleansing, and management processes.
- Collaborate with stakeholders to define and meet specific data requirements.
- Leverage event-driven cloud platforms to support applications and services.
Required Skills
- 7+ years of experience in Data Engineering and ETL.
- 3+ years of hands-on experience with Azure Data Engineering and Databricks.
- Proficiency in Python and PySpark.
- Deep technical knowledge of Azure Data Factory, Azure Synapse, SQL DB, and ADLS.
- Strong experience in data modeling.
- Expertise in data ingestion, egress, and transformation workflows.
- Any Graduate degree.
Preferred Skills
- Azure Certified Data Engineer.
- Experience with Azure DevOps, GitHub, and cloud migration methodologies.
- Ability to drive customer calls independently.