Description

You will build and maintain data pipelines by fetching, cleansing, and structuring data from various online sources.

Responsibilities

• Develop highly reliable web crawlers and parsers to extract data from multiple websites.
• Build APIs on top of processed datasets.
• Create frameworks to automate the continuous flow of data from diverse sources.
• Extract structured and unstructured data for storage in SQL and NoSQL databases.
• Troubleshoot and debug data extraction and processing workflows.

Required Skills

• 1 to 2 years of experience in Python, HTML, and JavaScript development.
• Deep knowledge of web crawling and web scraping techniques in Python.
• Proficiency with regular expressions.
• Understanding of data storage procedures and database basics.
• Experience working with SQL and NoSQL data stores.
• Ability to handle both structured and unstructured data.
• Any Graduate degree.

Key Skills

Education

Any Graduate