← Back to jobs

CareerNet Technologies Pvt Ltd Logo
Senior Data Engineer - Big Data Machine Learning

CareerNet Technologies Pvt Ltd

 

Bengaluru, Karnataka, India

Posted On: 2 days ago
Experience: 8+ years
Availability: Onsite
Openings: 1
Category: Senior Data Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will design and build large-scale data products and machine learning pipelines to power real-time personalized user experiences.

This role is on-site.

Responsibilities

  • Build, optimize, and maintain data architecture for capturing, storing, processing, and querying petabyte-scale data.
  • Develop internal platforms like Feature Stores to accelerate model training and simplify feature engineering.
  • Design data products including recommendation systems, customer segmentation, and engagement platforms.
  • Process large-scale streaming datasets to enable real-time personalization.
  • Provide architectural direction and select technologies aligned with domain-specific requirements.

Required Skills

  • 8-12 years of hands-on experience with Big Data technologies, specifically Spark and Scala.
  • Proficiency in stream processing engines such as Flink or Spark Structured Streaming.
  • At least 2 years of experience with cloud deployment on AWS, Azure, or Google Cloud Platform.
  • Strong expertise in data modeling, database design, and analytical processing on large datasets.
  • Proven experience deploying Business Data Lakes and NoSQL databases.
  • Deep understanding of distributed systems, JVM-based systems, and Spark performance tuning.
  • Experience architecting domain-centric Big Data solutions.
  • Ability to evaluate and select appropriate Big Data, NoSQL, and analytics frameworks.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs