Description

You will design and manage data governance and Master Data Management (MDM) frameworks in a cloud environment.

Responsibilities

• Implement, test, debug, and deploy data governance pipelines using Airflow, Kafka, or Spark.
• Manage Role Based Access Control (RBAC) across Spark, Presto, S3, and Apache Ranger.
• Administer data observability, discovery, and lineage solutions using Apache Atlas.
• Develop backend services and data pipelines using Python.
• Manage cloud operations and infrastructure configuration using Terraform or CloudFormation.

Required Skills

• 5+ years of experience in data engineering roles.
• Proven experience in Master Data Management (MDM) or Data Governance.
• Proficiency in Python for data pipeline development.
• Strong SQL skills for analytical querying and data processing.
• Hands-on experience with AWS.
• Experience with Kafka and Airflow.
• Experience with Presto and Spark.
• Experience with Terraform or CloudFormation.
• Experience with Apache Atlas for data lineage.

Key Skills

Education

Any Graduate