Description

You will build and maintain data pipelines for a high-volume Electronic Medical Records (EMR) application.

Responsibilities

• Design, develop, and debug PySpark applications to process large datasets.
• Optimize Spark code for scalability, performance, and maintainability.
• Develop microservices using AWS Lambda, SNS, and DynamoDB.
• Support the migration of existing EMR applications to AWS Glue.
• Maintain production systems and implement enhancements for Machine Learning and Master Data integrations.

Required Skills

• 3-5 years of experience with Apache Spark.
• 3-5 years of experience with AWS Glue.
• Extensive experience in PySpark application development and troubleshooting.
• Hands-on experience with performance tuning for Spark applications.
• 1-5 years of experience developing microservices with AWS Lambda, SNS, and DynamoDB.
• Proficiency in GitHub for code management.
• 4+ years of overall professional experience.
• Degree in any graduate field.

Preferred Skills

• Experience with Databricks.
• Experience with Node.js or Vue.js.

Key Skills

Education

Any Graduate