From Text to Context: How We Introduced a Modern Hybrid Search — Ansgar Gruene, Dharin Shah
[EuroPython 2024 — North Hall on 2024-07-10] From Text to Context: How We Introduced a Modern Hybrid Search by Ansgar Gruene, Dharin Shah https://ep2024.europython.eu/session/from-text-to-context-how-we-introduced-a-modern-hybrid-search Customers only buy the products they are able to find. Improving the search functions on the website is crucial for user-friendliness. In our talk we present the lessons learnt from improving the search of our global online marketplace, which sells 20 million products per year. We moved from a traditional word-match based approach (BM25) to a modern hybrid solution that combines BM25 with a semantic vector model, an open-source language model that we fine-tuned to our domain. With numerous references to current literature, we will explain how we designed our new system and solved the multiple challenges we encountered on both the ML and engineering side (data pipeline encoding documents, live service encoding queries, integration with search engine). Our system is based on OpenSearch, the lessons can be applied to other search engines as well. In particular the presentation will cover: - Status and Short-Comings of our old Search - Introduction of Hybrid Search - Our Machine Learning Solution - Architecture and Implementation (with special consideration of latency) - Learnings and Next Steps --- This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License: https://creativecommons.org/licenses/by-nc-sa/4.0/