Description

You will build and maintain scalable web scraping solutions.

Responsibilities

• Develop and maintain scalable web scraping solutions using Python.
• Scrape data from both static and dynamic websites.
• Handle pagination, authentication, and anti-bot mechanisms during scraping.
• Clean, structure, and store scraped data efficiently.
• Collaborate with internal teams to meet data requirements.

Required Skills

• 3+ years of professional experience.
• Strong knowledge of Python.
• Proficiency with Beautiful Soup, Requests, Scrapy, Selenium, and Playwright.
• Solid understanding of HTML, CSS, and XPath.
• Experience managing IP blocking, CAPTCHA, rate limits, and proxies.
• Familiarity with data formats including CSV, JSON, and Excel, and database interaction.

Key Skills

Education

Any Gradute