Description

You will build and implement data lineage frameworks to track data flow across multiple systems, databases, and pipelines.

Build data lineage frameworks to track data movement across systems, databases, and pipelines. Map end-to-end data flows by identifying sources, transformations, destinations, and dependencies. Implement solutions to catalog metadata from MongoDB, Snowflake, and relational databases. Develop automation tools and scripts to capture and maintain lineage information and catalog updates. Monitor data quality to ensure lineage reflects accurate transformations and business rules. Document technical requirements, specifications, and data lineage for technical and business users.

Required Skills

• 5+ years of professional experience.
• Strong expertise in SQL, stored procedures, and triggers.
• Proficiency in Python, Java, or other scripting languages for data integration and automation.
• Experience with relational databases including SQL Server, DB2, and Sybase.
• Hands-on experience with MongoDB and Snowflake.
• Solid understanding of data modeling, ETL pipelines, and data transformation.
• Strong knowledge of Object-Oriented programming, data structures, and algorithms.
• Experience in data engineering or data governance with a focus on metadata cataloging.
• Ability to analyze business processes and coordinate with multiple stakeholders.

Preferred Skills

• Experience using Collibra for data governance.
• Knowledge of metadata management and extracting metadata from complex sources.
• Understanding of data privacy regulations like GDPR or CCPA.

Key Skills

Education

Any Gradute