Description

You will maintain and enhance ML model infrastructure in production, focusing on migrating and optimizing code to PySpark on AWS.

Responsibilities

• Develop and maintain ML models in production using Python, PySpark, or Scala.
• Migrate existing model code to PySpark on AWS EMR.
• Enhance and optimize PySpark code for performance and reliability.
• Manage data processing workflows using AWS MapReduce and EMR.

Required Skills

• 5+ years of experience with Python and PySpark.
• Strong proficiency in Spark SQL and AWS services, specifically EMR.
• Experience with AWS MapReduce.
• Ability to write and maintain production-grade ML models.
• Bachelor’s degree in a technical field (Any Graduate).

Preferred Skills

• Experience with Databricks (Lakeview, MLview).
• Knowledge of Terraform for infrastructure management.
• Proficiency in Scala.

Key Skills

Education

Any Gradute