Description

You will build and manage large-scale data processing systems using Scala and Apache Spark.

Responsibilities

• Develop complex data pipelines using Scala and Apache Spark.
• Manage and maintain databases including PostgreSQL, MySQL, and DynamoDB.
• Write scripts using Python or NodeJS for automation and integration.
• Debug Java-based applications and optimize data workflows.
• Utilize version control platforms like GitLab, GitHub, or Bitbucket to manage code.

Required Skills

• 10+ years of total IT experience.
• 5+ years of expert-level development in Scala and Apache Spark.
• 2+ years of experience with AWS services including EMR, Kinesis, S3, Lambda, API Gateway, and Advanced IAM.
• 2+ years of scripting experience with Python or NodeJS.
• Strong debugging skills in Java.
• Proficiency with PostgreSQL, MySQL, or DynamoDB.
• Experience with Git-based version control (GitLab, GitHub, or Bitbucket).
• Bachelor's Degree.

Preferred Skills

• Hands-on experience with monitoring tools such as AWS CloudWatch, DataDog, Splunk, or Nagios.
• Experience with Infrastructure as Code (IaC) using Terraform.

Key Skills

Education

Bachelor's Degree