Description

Focus on optimizing Scala Spark jobs and DynamoDB storage solutions for large-scale data processing.

Responsibilities

• Develop and optimize Scala-based Spark jobs to process large datasets efficiently.
• Design and implement data models and storage solutions using Amazon DynamoDB.
• Identify performance bottlenecks in existing Spark jobs and DynamoDB interactions.
• Optimize Spark configurations, data partitioning, and DynamoDB read/write operations.
• Collaborate with data engineers, architects, and DevOps teams to integrate jobs into the data ecosystem.

Required Skills

• 8+ years of professional experience.
• Strong proficiency in Scala.
• Experience with Scala Spark for large-scale data processing.
• Medium-strong expertise in Amazon DynamoDB.
• Ability to fine-tune DynamoDB indexing and data distribution.
• Experience optimizing Spark job configurations and resource consumption.
• Degree in any graduate field.

Key Skills

Education

Any Graduate