Description

You will lead the design and development of enterprise Master Data Management (MDM) solutions on Markit EDM CADIS, owning the full lifecycle from core matcher frameworks to golden record creation.

This role is on-site.

Responsibilities

• Architect and implement Core Matcher frameworks, entity resolution, survivorship rules, and E2E data mastering pipelines including Data Constructors and Rules Engines.
• Design and develop Workflow UI components for user-driven stewardship flows, implementing data governance workflows, approval processes, and audit trails.
• Implement real-time data processing and notifications using Apache Kafka and Confluent, integrating EDM into enterprise event ecosystems.
• Develop and expose RESTful APIs using Data Generators and Process Launchers, integrating with microservices architectures in Spring Boot, Java, and Node.js.
• Deploy and manage EDM solutions on AWS or Azure, utilizing Glue, Lambda, S3, and RDS, while integrating with modern data platforms like Snowflake and Databricks.

Required Skills

• 5+ years of experience with Markit EDM (IHS) and 10+ years total in data engineering or MDM solutions.
• Strong expertise in Core Matcher design, data mastering pipelines, and Workflow UI development.
• Hands-on experience with Apache Kafka or equivalent streaming technologies for event-driven architectures.
• Proficiency in Python, PySpark, and Spark SQL for large-scale data transformation and enrichment pipelines.
• Experience with AWS or Azure cloud services, including ETL orchestration, serverless triggers, and data lake integration.
• Strong database experience across RDBMS (SQL Server, Oracle, PostgreSQL) and cloud data warehouses (Snowflake, Redshift).
• Experience with CI/CD pipelines (GitHub, GitLab, Jenkins, Azure DevOps) and Infrastructure as Code (Terraform, CloudFormation).
• Knowledge of containerization with Docker and Kubernetes for microservices deployment.

Preferred Skills

• Experience with Markit EDM Cloud 19x and domain knowledge in Party, Client, or Instrument MDM.
• Exposure to data governance frameworks such as Collibra or Alation.

Key Skills

Education

Bachelor's degree