Description

You build and maintain data pipelines for document ingestion and metadata capture.

Responsibilities

• Orchestrate data workflows using Azure Data Factory (ADF).
• Utilize Databricks for unit cataloging and metadata management in data lakes.
• Implement transformations and models using dbt.
• Write efficient, maintainable, and scalable Python code.
• Support data pipeline architecture, performance tuning, and workflow optimization.

Required Skills

• 5+ years of professional experience.
• Proven experience with Azure Data Factory (ADF) for workflow orchestration.
• Strong experience with Databricks and managing metadata/document workflows in data lakes.
• Hands-on experience with dbt for data modeling and transformation.
• Advanced Python programming skills.
• Experience with cloud-based data ingestion, preferably Google Vertex AI.
• Solid understanding of Data Architecture, pipeline design, and data governance principles.

Preferred Skills

• Experience with enterprise-scale data integration projects.
• Familiarity with the M365 ecosystem or similar cloud platforms.

Key Skills

Education

Any Gradute