Description

Build and manage data movement strategies and ETL pipelines within the Azure ecosystem to support pricing systems.

Responsibilities

• Design and implement data movement strategies from diverse sources to the PriceFx ecosystem using Azure Data Factory.
• Develop and optimize ETL pipelines to ensure reliable data integration and transformation.
• Architect and implement Python-based API extensions with a focus on scalability and performance.
• Own end-to-end development cycles, including coding, testing, debugging, and deployment.
• Collaborate with data scientists to develop algorithms and models.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency with Azure Data Factory and Azure Databricks.
• Strong Python programming skills, including experience with Flask or similar frameworks for API development.
• Experience with relational data processing using MS SQL, SQL Server, Spark SQL, or Delta Lake.
• Hands-on experience with Azure DevOps and GitHub for version control and orchestration.
• Familiarity with cloud-based data storage solutions and data lakes.
• Bachelor’s degree in Computer Science or a related field.

Preferred Skills

• Deep understanding of pricing analytics and automotive industry pricing dynamics.

Key Skills

Education

Any Graduate