Description

Key Skills: Pyspark, SQL, Python, AWS Cloud, Elastic Search, Azure Cloud

Roles and Responsibilities:

• Responsible for designing, implementing, and optimizing enterprise search solutions and managing Elasticsearch clusters to ensure high availability, scalability, and relevance.
• Architect and maintain self-hosted Elasticsearch clusters, including node configuration, replication, and sharding strategies.
• Implement backup and recovery processes for Elastic indices.
• Develop and optimize semantic search capabilities using machine learning models (e.g., BERT-based ELSER).
• Enhance search relevancy through role-based indexing and boosting strategies.
• Collaborate with cross-functional teams to integrate Elastic with knowledge management tools and improve user experience.
• Monitor cluster performance and apply best practices for scalability and observability.

Skills Required:

• 10 - 13 years of relevant experience in data engineering and search technologies
• Hands-on experience with Elasticsearch administration, cluster management, replication, and sharding strategies
• Expertise in Python or Java for Elastic API integrations
• Strong PySpark skills for data processing and indexing pipelines
• Cloud experience with AWS and/or Azure
• Knowledge of backup, disaster recovery, and high-availability strategies in Elasticsearch
• Familiarity with search relevancy algorithms, semantic search, and ML-based search models (e.g., BERT-based ELSER)
• Experience with role-based indexing, boosting strategies, and metadata enrichment
• Knowledge of knowledge graphs for enterprise data integration
• Strong problem-solving, optimization, and performance tuning skills for large-scale search systems

Education: Bachelor's degree in Computer Science, Information Technology, or related field; advanced degrees preferred

Key Skills

Education

Any Graduate