Description

You will own the design and implementation of data pipelines.

This role is hybrid.

Responsibilities

• Architect and implement data pipelines using Databricks and Delta Lake for batch and streaming data.
• Develop and maintain ETL/ELT workflows integrating diverse data sources into cloud data lakes and warehouses.
• Implement data governance, security, and compliance standards.
• Automate workflows using Python scripting and CI/CD pipelines.
• Troubleshoot and resolve issues in data ingestion, transformation, and storage.

Required Skills

• 8+ years in data engineering or related roles.
• Expert-level Python programming for data processing and automation.
• Hands-on experience with Databricks and Delta Lake.
• Strong knowledge of Azure Data Factory, Data Lake, and Synapse.
• Proficiency in SQL and performance tuning.
• Familiarity with DevOps practices, CI/CD, and infrastructure-as-code tools.
• Experience with data migration and cloud-native architectures.

Key Skills

Education

Any Gradute