Description

You will design and implement data pipelines using Scala, Spark, and Kafka within AWS environments.

This role is on-site.

Responsibilities

• Write expert-level Scala code on Databricks and AWS.
• Develop and optimize complex SQL queries for data processing.
• Design and implement data models to support business requirements.
• Manage and maintain data quality across pipelines.
• Utilize Kafka for real-time data streaming.

Required Skills

• 3-5 years of experience writing Scala code on Databricks or AWS.
• Strong proficiency in SQL and query writing.
• Extensive experience with Spark.
• Hands-on experience with AWS.
• Experience with Kafka.
• Experience with Databricks or Snowflake.
• Strong background in data modelling.
• Proven experience in data quality management.

Preferred Skills

• Experience with networking and security protocols.

Key Skills

Education

Any Graduate