Respond AI: Enhance Knowledge Source Retrieval System
in progress
W
Wilson Tan
Business Problem:
Currently, AI Agent and AI Assist occasionally fail to retrieve accurate information from knowledge sources, even when the information exists. These challenges arise due to:
- Knowledge Source Formatting:Improperly formatted sources may lead to retrieval errors. Users can follow guidelines here to improve formatting.
- Non-English Knowledge Sources:Information in languages other than English is not consistently handled by the system.
In some cases, the AI may still fail to retrieve accurate information despite correct formatting and content due to technical limitations inherent to AI technology.
Desired Outcome:
Enhance the knowledge source retrieval system to address these two core issues:
- Improve AI handling of non-English knowledge sources.
- Mitigate dependency on perfect formatting by refining retrieval methods.
This enhancement would lead to higher accuracy and reliability in AI Agent and AI Assist responses, reducing errors and improving user satisfaction.
N
Nabilah Binti Salleh
Merged in a post:
Prioritize knowledge base
Dewald Labuschagne
Being able to set a prioritization list for knowledge base.
Eg. First check the FAQ document - if no answer is found move to the next knowledge source on the list. NOT using all knowledge bases at once.
S
Shi Hui
in progress
Dewald Labuschagne
Hi Wilson
That's great to hear!
Yes that sounds like exactly the use case we need. I find using our website as a knowledge source causes the bot to hallucinate frequently. So, what I want to do is migrate the knowledge from the website to the FAQ document to ensure we have frim hand on what information the bot uses.
So we want to say
If ( Information is in knowledge_source_1)
use knowledge_source_1
else if ( Information is in knowledge_source_2)
use knowledge_source_2
else
use knowledge_source_3
So that we can add the most important information in the prioritized knowledge sources to ensure the bot only uses the information we want it to use for those types of queries.
Then the website becomes a secondary source for queries we did not account for.
W
Wilson Tan
Hi Dewald Labuschagne thanks for the message! We're working on improving our knowledge retrieval model as we speak https://respond.canny.io/admin/feedback/feature-request/p/respond-ai-enhance-knowledge-source-retrieval-system?boards=feature-request&search=knowledge%2520retrieval
May I know what's your use case on this? The new retrieval tool that we're working on would already have some sort of scoring and prioritisation method, for example, it will look at 10 knowledge source at the same time, and rank it then uses the top 10 ranked information
N
Nabilah Binti Salleh
planned