Description

You will design and build large-scale data products and machine learning pipelines to power real-time personalized user experiences.

Responsibilities

• Build, optimize, and maintain data architecture for capture, storage, processing, and querying of petabyte-scale data.
• Develop internal platforms, such as Feature Stores, to accelerate model training and simplify feature engineering.
• Design data products including recommendation systems, customer segmentation, and engagement platforms.
• Process large-scale streaming datasets to enable real-time personalization.
• Provide architectural direction and select technologies aligned with domain-specific requirements.

Required Skills

• 8-12 years of hands-on experience with Big Data technologies, specifically Spark and Scala.
• Proficiency in stream processing engines such as Flink or Spark Structured Streaming.
• At least 2 years of experience with cloud deployment on AWS, Azure, or Google Cloud Platform.
• Strong expertise in data modeling, database design, and analytical processing on large datasets.
• Proven experience deploying Business Data Lakes and NoSQL databases.
• Deep understanding of distributed systems, JVM-based systems, and Spark performance tuning.
• Experience architecting domain-centric Big Data solutions.
• Ability to evaluate and select appropriate Big Data, NoSQL, and analytics frameworks.

Key Skills

Education

Any Graduate