Description

You will own the full lifecycle of analytics data engineering, focusing on Python-driven extraction, processing, and orchestration across Azure and AWS environments.

Responsibilities

• Develop and maintain robust data pipelines using Python and core analytics libraries.
• Implement web scraping and data extraction workflows utilizing Selenium and BeautifulSoup.
• Manage data processing tasks and transformations within Azure Databricks and AWS ecosystems.
• Orchestrate complex, multi-step data workflows using Apache Airflow.
• Maintain version control and deployment cycles through Git and Azure DevOps CI/CD.

Required Skills

• 12+ years of experience in analytics data engineering.
• 6+ years of professional Python experience, including virtual environments and core concepts.
• Deep expertise with NumPy, pandas, BeautifulSoup, Selenium, pdfplumber, Requests, and psycopg2.
• Proficiency with PostgreSQL database management.
• Hands-on experience with Azure Databricks and AWS cloud services.
• Proven track record with Apache Airflow for workflow orchestration.
• Experience with Git source control and Azure DevOps CI/CD pipelines.
• Any Graduate degree.

Preferred Skills

• Experience with pdfplumber for document parsing.

Key Skills

Education

Any Graduate