Description

You will build and maintain the infrastructure necessary to transform raw data into actionable information.

Responsibilities

• Create, test, and maintain data pipeline architectures.
• Automate manual data flows to ensure scalability and repeated use.
• Operationalize mathematical and machine learning models.
• Implement data quality checks to ensure accuracy and consistency.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency in Python using Pandas and Numpy.
• Strong SQL skills for data manipulation.
• Experience with Apache Airflow for orchestration.
• Testing expertise using Pytest and Test Driven Development (TDD) principles.
• Knowledge of Scikit-Learn and Machine Learning concepts.
• Experience with API development.
• Degree in any graduate field.

Preferred Skills

• Experience with Kubernetes or equivalent container orchestration.
• Proficiency with CI/CD pipelines and Git.

Key Skills

Education

Any Graduate