Description

You will build and maintain scalable data pipelines and ETL/ELT workflows using Python. You will integrate structured and unstructured data, optimize database performance, and implement monitoring processes. You will collaborate with analysts and scientists to support cloud data platforms.

This role is on-site.

Responsibilities

• Develop efficient data pipelines and ETL/ELT workflows in Python.
• Integrate data from multiple sources and optimize database performance.
• Implement data validation, monitoring, and CI/CD practices.
• Support cloud data platforms and big data ecosystems.
• Collaborate with data teams to ensure data quality and availability.

Required Skills

• Strong hands-on experience in Python development.
• Advanced SQL knowledge and experience with data pipeline tools.
• Knowledge of APIs and data integration techniques.
• Familiarity with AWS, Azure, or GCP cloud services.
• Understanding of data warehousing and data lake concepts.
• Experience with Git and CI/CD practices.
• Bachelor's degree in a relevant field.
• 5+ years of experience in data engineering.

Preferred Skills

• Experience with Spark, Kafka, Airflow, Snowflake, Databricks, or Redshift.
• Knowledge of Agile methodologies.

Key Skills

Education

Bachelor's degree