Description

Design, implement, and optimize enterprise search solutions using Elasticsearch and cloud infrastructure.

Responsibilities

• Architect and maintain self-hosted Elasticsearch clusters, configuring nodes, replication, and sharding strategies for high availability.
• Develop and optimize semantic search capabilities using machine learning models, such as BERT-based ELSER.
• Build and optimize data processing and indexing pipelines using PySpark and SQL.
• Implement backup, recovery, and disaster recovery processes for Elasticsearch indices.
• Enhance search relevancy through role-based indexing, boosting strategies, and metadata enrichment.

Required Skills

• 10-13 years of experience in data engineering and search technologies.
• Hands-on expertise in Elasticsearch administration, cluster management, and performance tuning.
• Strong proficiency in Python or Java for Elastic API integrations.
• Expert-level PySpark skills for large-scale data processing.
• Cloud experience with AWS and/or Azure environments.
• Deep knowledge of search relevancy algorithms, semantic search, and ML-based models.
• Understanding of knowledge graphs for enterprise data integration.

Key Skills

Education

Any Graduate