{"id":77,"date":"2024-03-02T17:11:00","date_gmt":"2024-03-02T17:11:00","guid":{"rendered":"https:\/\/sanjayk7r.com\/?p=77"},"modified":"2024-03-07T16:53:59","modified_gmt":"2024-03-07T16:53:59","slug":"power-up-llm-with-hybrid-search-rag","status":"publish","type":"post","link":"https:\/\/sanjayk7r.com\/index.php\/2024\/03\/02\/power-up-llm-with-hybrid-search-rag\/","title":{"rendered":"Power up LLM bots with RAG + Hybrid search"},"content":{"rendered":"\n
\"\"<\/figure>\n\n\n\n

Retrieval-Augmented Generation or RAG is important because it helps LLMs give more accurate answers by also including content (or context) from your private data. See this post on how you can implement RAG quickly and securely.<\/a><\/p>\n\n\n\n

With RAG, your private data is stored as an embedding in a vector database. Depending on the user query, data is retrieved from this database using a type of search called “semantic search.” Semantic search is cool because it understands questions more like a human does. i.e “cost” and “price” mean the same thing. <\/p>\n\n\n\n

But, it’s not perfect. It sometimes misses relevant keywords. In some cases the precise keyword must be included in the query e.g. brand or website name to get correct results.<\/p>\n\n\n\n

Hybrid Search<\/h5>\n\n\n\n

To improve this, Amazon Bedrock introduced a new feature called “hybrid search.” Hybrid search combines semantic search with the old-school keyword search. It uses the strengths of both to give you better results. Here is an example:<\/p>\n\n\n\n

what is the cost<\/mark> of the cycle of the brand <brand<\/mark>> on <website<\/mark>>?<\/code><\/pre>\n\n\n\n
In this query a semantic search for “cost” and a keyword search for “brand” and “website” will yield a better search result or context.<\/p>\n\n\n\n
The Bedrock AWS console currently offers 3 options for you to query your vector database.<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
\ud83d\udc50<\/h2>\n\n\n\n
Thats it, with hybrid search you are going to get more accurate answers from your foundation models (FM). Note that semantic search is more precise when the domain is narrow and there is little room for misinterpretation.<\/p>\n\n\n\n
\ud83d\udc49 For more details, you can visit the full blog post here<\/a>.<\/p>\n\n\n\n
\ud83d\udc49  Want to try RAG on Bedrock? Here a github repo<\/a> to help you get started.<\/p>\n\n\n\n
\ud83d\udc49 Here is a superb video on the topic as well<\/p>\n\n\n\n
\n