Description

You will design and implement Master Data Management (MDM) solutions on Databricks, leveraging Python and PySpark for large-scale data processing. You will build and manage data pipelines using Airflow, deploying complex cloud-based applications on AWS or GCP within a Linux environment. Your work will include developing reporting and visualization layers using tools like Tableau, SSRS, or Power BI, while applying strong consulting skills to translate business requirements into technical data management strategies.

Responsibilities

• Architect and develop MDM and data management solutions using Databricks.
• Write efficient Python and PySpark code for data transformation and engineering.
• Orchestrate data workflows and pipelines using Apache Airflow.
• Deploy and maintain cloud applications on AWS or GCP infrastructure.
• Create and support reporting dashboards and visualization tools for stakeholders.

Required Skills

• 12+ years of experience in data engineering and cloud application development.
• Expert-level proficiency with Databricks, Python, and PySpark.
• Hands-on experience with Apache Airflow for workflow orchestration.
• Strong command of Linux operating systems and command-line tools.
• Practical experience deploying applications on AWS or GCP.
• Proven consulting skills with a track record of client-facing data management projects.
• Experience with reporting and visualization tools such as Tableau, SSRS, or Power BI.

Preferred Skills

• Deep understanding of MDM concepts and general data governance frameworks.
• Experience integrating cloud data platforms with enterprise reporting systems.

Key Skills

Education

Any Graduate