Description

You will develop and maintain a Scala-based, distributed data processing platform.

Responsibilities

• Design and build scalable services for large-scale data processing and management.
• Integrate with AWS (S3, STS) and GCP (BigQuery, Dataflow, Pub/Sub) cloud services.
• Manage build processes using sbt and handle JSON data with Circe.
• Conduct unit, component, and integration testing to ensure code quality.
• Troubleshoot issues within distributed, cloud-based environments.

Required Skills

• 3+ years of experience in data engineering or backend systems.
• Expertise in big data processing.
• Proficiency with Scala and functional programming principles.
• Experience with concurrent programming using FS2 and cats-effect.
• Familiarity with SQL and PostgreSQL for data storage.
• Experience with AWS and GCP services.
• Strong problem-solving and debugging abilities.
• Bachelor’s in Computer Science or related field.

Preferred Skills

• Experience with Finagle, orchestration/workflow tools, or Kubernetes.
• Knowledge of performance optimization techniques.

Key Skills

Education

Bachelor’s in Computer Science