Description

About the job
We are seeking an experienced Data Engineering Manager to own and scale a critical web data acquisition program. This is a hands-on leadership role requiring deep technical expertise, strong stakeholder engagement, and the ability to take full ownership of delivery after onboarding.
The successful candidate will act as the technical and operational anchor of the program—driving architecture decisions, ensuring engineering quality, aligning offshore and onshore teams, and maintaining momentum across business, data, and IT stakeholders.
Key Responsibilities
Take end-to-end ownership of the data scraping program following onboarding.
Engage directly with business users and product owners to understand data requirements and usage.
Lead technical discussions on scraping architecture, data pipelines, scalability, resilience, and compliance.
Review code, scraping logic, and system design to ensure quality, performance, and maintainability.
Identify technical risks early (e.g., site changes, blocking, legal constraints) and proactively define mitigation strategies.
Work closely with the Head of Data, Head of IT, and business stakeholders to align expectations and delivery outcomes.

Required Experience & Skills
Must-Have
Proven experience in a Data Scraping / Web Data Engineering Lead or Senior Engineer role, atleast 12 plus years of relevant experience with team lead experience.
Strong hands-on expertise with web scraping technologies and frameworks (e.g., Python-based scraping, APIs) , databricks
Experience reviewing production-grade code and system designs.
Demonstrated ability to lead technical programs with multiple stakeholders.
Prior experience working with offshore or distributed engineering teams.
Strong communication skills, with the ability to translate between technical and business audiences.

Requirements added by the job poster

• 5+ years of work experience with Python (Programming Language)

• 7+ years of work experience with Azure Databricks

Key Skills

Education

Any Graduate