In testing the Agentic Assistant, I've tried to get it to return the exact knowledge base article text. However, there is a strong tendency to truncate the article, about a paragraph in length (556 characters). I have added guidelines to always return the knowledge base article text verbatim but the LLM does not respect it. I've also added this directive (and variants) to the KB pre-instruction but it also does not return the exact wording.
For example I've tried this guidleline:
If a question is answered by a knowledge article, repeat the knowledge article text verbatim. Say exactly what is in the knowledge article.
It is important to return the exact text since it is vetted by legal.
Also I do not like the way the guideline is taken as input and translated by Genesys to a prompt for the LLM. I would prefer that our guidelines are fed directly to the LLM so there is no loss in translation.
Anyone have the magic prompt to get the LLM to return the KB text exactly?
#Uncategorized------------------------------
Jack Liu
------------------------------