Description

Build and maintain the data infrastructure and pipelines that enable data science teams to execute models effectively.

Responsibilities

• Design and develop a Feature Store for data scientists using Python and IBM Cloud Pak for Data.
• Build and optimize data input/output pipelines for model execution.
• Develop, build, and deploy containerized applications using Docker or Podman.
• Manage code repositories and version control workflows using GitHub.
• Optimize SQL queries to ensure efficient data retrieval and processing.

Required Skills

• 5-7+ years of total experience in data engineering or data science infrastructure.
• Strong proficiency in Python for building data frameworks and pipelines.
• Solid SQL skills with a focus on query optimization.
• Experience with containerization tools such as Docker or Podman.
• Familiarity with IBM Cloud Pak for Data or similar data platforms.
• Proficiency with GitHub for version control and collaboration.

Preferred Skills

• Experience with Apache Kafka for data streaming.
• Exposure to AWS SageMaker for model execution.
• Knowledge of Snowpark or Linux environments.

Key Skills

Education

Any Graduate