Description

You will design and implement scalable data pipelines and engineering components to support machine learning and finance data warehousing.

Responsibilities

• Build scalable data pipelines to generate training datasets for machine learning deliverables.
• Design, implement, and monitor Dev frameworks and coding standards.
• Coordinate with data source teams to publish data to the Finance Data Warehouse.
• Mentor junior engineers and drive end-to-end design and delivery of engineering components.
• Participate in design and code reviews to ensure quality, testability, and security.

Required Skills

• 10+ years of experience in data engineering.
• Hands-on experience with Azure and Snowflake data warehouses.
• Proficiency with Kafka technologies for real-time messaging and analytics.
• Experience building and maintaining CI/CD pipelines.
• Expertise in designing data table structures, reports, and queries.
• Ability to build performant and secure code.
• Experience implementing data integrity checks as part of application delivery.
• Proven ability to perform POCs and evaluate new technologies.
• Experience working with large volume data.

Preferred Skills

• Experience with Microservices architecture.
• Retail industry experience.
• Knowledge of Microsoft Azure Data Factory, Oracle Exadata, Power BI, SSAS, or Oracle Data Integrator.

Key Skills

Education

ANY GRADUATE