Description

You will build and maintain data extraction systems using web scrapers and crawlers.

Responsibilities

• Develop web scrapers and crawlers to retrieve data for storage in structured formats.
• Execute data cleansing processes to ensure data integrity and correct formatting.
• Integrate multiple data sources and databases into a single unified system.
• Manage log files and monitoring through custom scripting.
• Implement scalable application designs using threading and multi-process architectures.

Required Skills

• 5+ years of experience in Python development.
• Proficiency with BeautifulSoup and Selenium for data extraction.
• Strong understanding of Python threading and multi-process architecture.
• Experience with MySQL and MongoDB.
• Working knowledge of JavaScript and HTML.
• Familiarity with event-driven programming in Python.
• Ability to apply fundamental design principles for scalable applications.

Preferred Skills

• Additional experience with MongoDB integration.

Key Skills

Education

Any Graduate