Description

You will develop and maintain data pipelines using Python and related technologies.

Responsibilities

• Develop and optimize data processing workflows using PySpark and Pandas/Polars.
• Implement infrastructure as code using Terraform.
• Build and manage data workflows within Databricks environments.
• Write and execute tests using appropriate testing frameworks.
• Collaborate in an Agile methodology to deliver features.

Required Skills

• 5+ years of professional experience in development.
• Expert proficiency in Python.
• Hands-on experience with PySpark.
• Experience with Pandas/Polars for data manipulation.
• Familiarity with Databricks.
• Working knowledge of AWS services.
• Proficiency with Terraform.
• Experience implementing testing frameworks.
• Experience operating within an Agile methodology.

Key Skills

Education

Any Graduate