Description

Job Description

Skills:

• Apache Kafka
• Hadoop Hive
• Pandas
• Python

Future Duties and Responsibilities:

• Optimize and maintain large-scale feature engineering pipelines using PySpark, Pandas, and PyArrow on Hadoop-based infrastructure.
• Refactor and modularize ML codebases to enhance reusability, maintainability, and performance.
• Collaborate with platform teams on compute capacity planning, resource allocation, and system upgrades.
• Integrate with existing model serving frameworks to support testing, deployment, and rollback processes.
• Monitor and troubleshoot production ML pipelines, ensuring high reliability, low latency, and cost efficiency.
• Contribute to internal ML platforms by sharing insights, proposing improvements, and documenting best practices.
• Build near real-time ML pipelines using Kafka and Spark Streaming.
• Work with AWS and SageMaker MLOps ecosystem

Key Skills

Education

Any Graduate