Description

You will design and build data architectures for large-scale data processing and manage Big Data technologies including Business Data Lakes and NoSQL databases.

Responsibilities

• Design and build data architectures for large-scale data processing.
• Develop and maintain data models and database designs.
• Build and maintain stream processing using Spark Structured Streaming and Flink.
• Administer, configure, monitor, and tune Spark workloads and distributed JVM-based systems.
• Lead and support cloud deployments across AWS, Azure, or GCP.

Required Skills

• 4-6 years of hands-on experience with the Spark and Big Data tech stack.
• At least 4 years of experience writing Scala.
• At least 2 years of experience with cloud deployment (AWS, Azure, or GCP).
• Proven track record of at least 2 successful product deployments involving Big Data technologies.
• Experience with Spark Structured Streaming and Flink.
• Proficiency in Data Architecture and Data Modeling.
• Experience with NoSQL databases.
• Knowledge of JVM tuning and performance optimization.
• Experience working with large datasets and Big Data processing.

Key Skills

Education

Any Graduate