Description

You will own the data scraping program end-to-end after onboarding.

Responsibilities

• Engage with business users and product owners to define data requirements and usage.
• Lead technical discussions on scraping architecture, pipeline design, scalability, resilience, and compliance.
• Review code, scraping logic, and system designs for quality and maintainability.
• Identify technical risks (site changes, blocking, legal) and define mitigation strategies.
• Align expectations and delivery outcomes with the Head of Data, Head of IT, and business stakeholders.

Required Skills

• 12+ years of relevant experience, including team lead experience in a Data Scraping or Web Data Engineering Lead/Senior Engineer role.
• Strong hands-on expertise with Python-based scraping and APIs.
• Experience with Databricks.
• Demonstrated ability to review production-grade code and system designs.
• Proven experience leading technical programs with multiple stakeholders.
• Experience working with offshore or distributed engineering teams.
• Strong communication skills to translate between technical and business audiences.

Key Skills

Education

Any Gradute