Genesys Cloud - Main

 View Only

Sign Up

  • 1.  Creating the right prompt to generate a good summarie

    Posted 14 days ago

    Hi Community,

    Has anyone gained experience with writing Custom Prompts in the summaries configuration?

    We keep running into the same issue: even when the prompt explicitly instructs the model not to include certain information, the generated summary still contains details that must not appear.

    Specifically, we see this with health‑related information, sexual orientation, names, etc.

    Below is an excerpt from one of our prompts that enforces a "Not Use" rule.
    This example is in English, but in our system we normally write the prompts in Dutch.

    Example: excerpt of our prompt with the Not Use rule

    ---

    MUST NOT include personal names (first name, last name, full name) in the summary, agreements, or actions. If names appear in the transcript, always replace them with a role such as the customer, the partner, the son, the daughter, the guardian, the executor, the notary, or a third party. Never repeat names from the transcript, even if they are mentioned multiple times.
    ∙ MUST NOT include health information. Replace or redact.
    ∙ MUST NOT include sexual orientation. Replace or redact.
    ∙ MUST NOT include race or ethnicity. Replace or redact.
    ∙ MUST NOT include political views. Replace or redact.
    ∙ MUST NOT include religious beliefs. Replace or redact.
    ∙ MUST NOT include financial account numbers. Replace or redact.
    ∙ MUST NOT include license plates, citizen service numbers (BSN), or ID numbers. Replace or redact.
    ∙ MUST NOT use the words he, him, his, she, her, or they to refer to a person. Always replace with a role such as the customer, the partner, the guardian, who, or whose.
    ∙ MUST NOT use the employee's name. The employee's name is always listed on an Internal or Agent line at the start of the conversation.
    ∙ MUST NOT write more than 200 words. Aim for 100–150 words.
    ∙ MUST follow the exact format below. No additional sections or text.

    Role

    You are an AI assistant for Achmea that summarizes transcripts of customer conversations for the Mortgages Preventive and Special Management department. Use only what is actually stated in the transcript.

    Etc.

    Thanks allready for the reactions.

    With kind regards Marko


    #AIConfiguration

    ------------------------------
    Marko Konieczny
    Solution Architect
    ------------------------------


  • 2.  RE: Creating the right prompt to generate a good summarie

    Posted 14 days ago

    Hello Marko, 

    I have may have some tips for PII/Sensitive data handling. 

    The first being using the built in "Avoid PII" toggle. While this feature provides PII filtering for common entities, it does not guarantee complete PII compliance. However it does add an additional layer of protection beyond your custom prompts instructions. 

    The next would be to optimize your prompt structure. Lead with structure, not restrictions. What I mean by this is instead of starting with a long list of "MUST NOT" rules begin with what you DO want. Define the output structure first, then add the constraints. Also with this use positive framing, rather than must not include names try "Replace all personal names with role descriptors (customer, partner, guardian, etc)

    An example prompt that follows these rules is below:

    Role: You are an AI assistant for [Company] that summarizes customer conversations for the Mortgages department.
    
    Output Format:
    [Define your exact structure here - Issue/Actions/Resolution or whatever format you need]
    
    Content Rules:
    Use role descriptors only. Replace any personal names with: customer, partner, guardian, employee, third party.
    Omit or replace sensitive details including health information, financial account numbers, identification numbers.
    Write 100-150 words maximum.
    Be strictly factual. Do not infer or add information not explicitly stated in the transcript.
    
    Tone: Professional, objective, neutral.

    Hope this helps!



    ------------------------------
    Cameron
    Online Community Manager/Moderator
    ------------------------------



  • 3.  RE: Creating the right prompt to generate a good summarie

    Posted 14 days ago

    Hi Marko, 

    For Standard Summary Configurations: @Cameron Tomlin advice about the "Avoid PII" toggle, Participant Labels, and Custom Insights applies here. These built-in features add system-level protections:

    • Enable Avoid PII toggle
    • Configure Participant Labels for internal/external speakers
    • Use Custom Insights for structured data extraction
    • Select predefined insights

    Test using the Preview panel with multiple transcripts before deployment.

    For Custom Prompts (Advanced Configuration): When using the Advanced Custom Prompt option, you DON'T have access to those built-in toggles. @Cameron Tomlin prompt engineering advice becomes critical:

    • Lead with structure, not restrictions (define what you DO want first)
    • Use positive framing: "Replace all personal names with role descriptors" instead of "MUST NOT include names"
    • Define output format clearly upfront
    • Keep concise (100-150 words as you mentioned)

    Test your custom prompt extensively in the Preview panel against real Dutch transcripts, especially those that previously leaked PII. Test multiple prompt variations to find what performs best.

    Ensure Language Dialect is set correctly for your Agent Copilot integration.

    https://help.mypurecloud.com/articles/work-with-advanced-custom-summaries/



    ------------------------------
    Josh Coyle
    Senior Professional Services Consultant
    ------------------------------



  • 4.  RE: Creating the right prompt to generate a good summarie

    Posted 11 days ago

    Hi Josh and Cameron,

    Thank you for the tips.

    Regarding the PII toggle, we are already using it, including for our recordings and transcriptions.

    With respect to the summaries, regardless of which custom prompt structure we apply, the output remains inconsistent and does not give us much confidence.

    The structure I shared earlier was created based on guidance from a Genesys support ticket.

    I am therefore looking for a working structure that ensures the generation of summaries is 100% reliable.

    I would appreciate it if you could share some examples of prompts that have worked well for you.

    Thank you in advance.

    With kind regards 

    Marko



    ------------------------------
    Marko Konieczny
    Solution Architect
    ------------------------------



  • 5.  RE: Creating the right prompt to generate a good summarie

    Posted 11 days ago

    Hi Marko, 

    If you need more predictable, consistent results then the recommended approached would be to switch to Standard Summaries instead of Advanced Custom Prompts. Standard summaries use Genesys' built-in controls (Avoid PII toggle, Participant Labels, Custom Insights) which provide a rigid, structured approach with guardrails.

    Custom prompts are exactly that - completely custom - which means you're responsible for engineering prompts that work for your use case through extensive testing and iteration.

    If you need assistance optimizing your custom prompt or evaluating whether to switch to standard summaries, I recommend reaching out to your Genesys representative. They can engage Professional Services to support your specific requirements and help you achieve the best balance between customization and reliability.



    ------------------------------
    Josh Coyle
    Senior Professional Services Consultant
    ------------------------------



  • 6.  RE: Creating the right prompt to generate a good summarie

    Posted 11 days ago

    This is a really interesting thread, and one that another Genesys customer who I spoke with recently also complained about. The feeling was that Genesys use different AI models which might produce differences in the summary - not sure how true this is?

    I am going to review in time, but this guidance would be good to get in to the resource centre as, at my last check, it wasn't present in the Resource Centre  and would be really helpful to customers as they adopt the feature and try to get the best out of it.

    (Customizable summaries overview View summary - Genesys Cloud Resource Center)



    ------------------------------
    David Halliday
    ------------------------------