Description

You will build web crawlers and APIs to manage data flows from multiple online sources.

Responsibilities

• Develop highly reliable web crawlers and parsers to extract data from various websites.
• Extract structured and unstructured data for storage in SQL and NoSQL databases.
• Build APIs on top of cleansed data sets.
• Create frameworks to automate and maintain a constant flow of data from multiple sources.
• Troubleshoot and debug data collection processes.

Required Skills

• 1 to 2 years of experience in Python development.
• Strong knowledge of web crawling and web scraping in Python.
• Experience with core HTML and JavaScript.
• Proficiency with Regular expressions.
• Knowledge of data storage procedures and database basics.
• Experience working with SQL and NoSQL data stores.
• Ability to handle both structured and unstructured data.

Key Skills

Education

Any Graduate