Description

You will design, develop, and maintain scalable ETL pipelines using MS Azure Data Factory and Azure Databricks.

This role is hybrid.

Responsibilities

• Design and maintain ETL workflows using Azure Data Factory and Azure Databricks.
• Build data integration interfaces between internal systems and external platforms like Coupa and SAP.
• Optimize data workflows for performance, reliability, and cost-efficiency.
• Implement data quality checks, error handling, and logging mechanisms.
• Collaborate with stakeholders to translate data requirements into technical solutions.

Required Skills

• 5+ years of experience in ETL/ELT development, with 2+ years focused on Azure Data Factory.
• Strong proficiency in SQL and Postgres, including data transformation logic.
• Hands-on experience integrating with Coupa and SAP platforms.
• Expertise in extracting, transforming, and loading data from XML and JSON sources.
• Familiarity with CI/CD pipelines and version control tools such as Git and Azure DevOps.
• Experience with Unix/Linux shell scripting for automation and orchestration.
• Experience using Azure Blob Storage and Azure Functions.
• Solid understanding of data warehousing concepts and dimensional modeling.

Key Skills

Education

Any Graduate