Description

You will build and maintain data pipelines and API extensions to support a new pricing ecosystem.

Responsibilities

• Design and implement data movement strategies from diverse sources to the PriceFx ecosystem using Azure Data Factory.
• Develop and optimize ETL pipelines to ensure seamless data integration and transformation.
• Architect and implement Python-based API extensions, focusing on scalability, performance, and security.
• Use Azure Databricks for data processing, transformation, and analysis.
• Collaborate with data scientists and analysts to develop algorithms that enhance pricing calculation accuracy.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Strong Python programming skills.
• Proficiency with the Azure ecosystem, specifically Azure Data Factory and Azure Databricks.
• Experience developing APIs using Flask or similar frameworks.
• Proven ability to design and implement ETL pipelines for data movement and transformation.
• Familiarity with cloud-based data storage solutions and data lakes.
• Experience with version control systems and collaborative development workflows.
• Ability to communicate technical concepts to both technical and non-technical stakeholders.

Preferred Skills

• Microsoft Certified: Azure Data Engineer Associate or similar Azure certifications.
• Prior experience building pricing solutions or analytics platforms for the automotive industry.
• Knowledge of data privacy and security best practices for sensitive pricing data.

Key Skills

Education

Any Graduate