Description

You will build, deploy, and maintain efficient web scrapers to extract data from diverse online sources.

Responsibilities

• Build and maintain reliable web scrapers using Java and core libraries.
• Automate and schedule scraping tasks using cron or enterprise schedulers like Airflow.
• Manage scraped data across SQL, NoSQL, and cloud-based storage platforms.
• Navigate scraping obstacles including CAPTCHAs, dynamic content, and IP blocking.
• Transform raw data into structured CSV and JSON formats through validation and cleansing processes.

Required Skills

• 3+ years of professional software engineering experience with a focus on Java development.
• Proven experience writing Java code specifically for web data extraction.
• 2+ years of experience with HTML, CSS, JavaScript, and XML for entity extraction.
• 2+ years of experience with Java scraping libraries such as Jsoup, Selenium, or HtmlUnit.
• Hands-on experience designing and querying SQL and NoSQL databases.
• Proficiency handling data formats including JSON and CSV.
• Bachelor’s degree in Computer Science, Software Engineering, IT, or a related technical field.
• English proficiency of B2 level or higher.

Preferred Skills

• Experience with cloud platforms like AWS, Google Cloud, or Azure.
• Familiarity with Git, CI/CD pipelines, and the full SDLC.
• Foundational understanding of network traffic analysis.

Key Skills

Education

Any Graduate