Description

Build and maintain data pipelines using Python-based scripting and automation.

Responsibilities

• Develop data processing scripts using Python libraries for algorithm implementation and data manipulation.
• Write and optimize complex SQL queries and manage Postgres SQL databases.
• Automate data extraction and scraping tasks using web and document parsing tools.
• Maintain CI/CD pipelines and version control workflows within an Agile environment.
• Coordinate with distributed teams across multiple time zones to deliver project milestones.

Required Skills

• 6+ years of experience in Python scripting, specifically for data processing rather than web or application development.
• Proficiency with NumPy, pandas, BeautifulSoup, Selenium, pdfplumber, and Requests.
• Strong SQL programming skills with experience in Postgres SQL.
• Experience with testing frameworks, specifically PyTest.
• Hands-on experience with AWS (S3) and Azure Databricks.
• Knowledge of DevOps tools including Jenkins, Git, and CI/CD workflows.
• Experience working within Agile and Scrum methodologies.

Preferred Skills

• Experience leading and motivating technical teams.

Key Skills

Education

Any Graduate