Description

You will build and maintain systems to extract, cleanse, and process data from various online sources.

Responsibilities

• Develop web crawlers and parsers to extract structured and unstructured data from multiple websites.
• Build APIs on top of processed data sets.
• Create frameworks to automate the constant flow of data from diverse sources.
• Store extracted data into SQL and NoSQL data stores.
• Troubleshoot and debug crawling and parsing logic to ensure data reliability.

Required Skills

• 1 to 2 years of experience in Python development.
• Strong knowledge of web crawling and web scraping techniques in Python.
• Experience with core HTML and JavaScript.
• Proficiency with Regular expressions.
• Understanding of data storage procedures and database basics.
• Experience working with SQL and NoSQL databases.
• Ability to handle data cleansing and extraction workflows.

Preferred Skills

• Experience building automated data pipelines.

Key Skills

Education

Any Graduate