Genesys Cloud - Developer Community!

 View Only

Sign Up

Back to discussions
Expand all | Collapse all

Live video agent via Google's Agentic framework

  • 1.  Live video agent via Google's Agentic framework

    Posted 2 days ago
    Edited by Lucas Woodward 2 days ago

    I wanted to share an experimental journey I've created that integrates Google's Agent Development Kit + Gemini Live into a Web Messenger session to allow the customer to use a Live Agent (audio/video) to complete a task before returning to the Web Messenger session to complete the journey.

    Video of the experiment (I can't embed LinkedIn videos here)

    I'm in the process of writing a newsletter post about the specifics of how it works, but here is an overview:

    1. Genesys Cloud Web Messenger starts and associates the Customer Journey Session ID with my backend Live AI Agent service
    2. The Genesys Cloud Digital Chatbot flow then starts the Live AI Agent by calling a Data Action that in turn calls the Live AI Agent's service
    3. The Live AI Agent streams audio/video from the UI over a WebSocket to ADK/Gemini Live
    4. Agent converses with customer and uses tools to scan barcodes and update memory - updating the memory causes the UI to update too
    5. When Live AI Agent finishes it calls a tool that opens the Web Messenger UI and triggers a Quick Reply in the Digital Chatbot flow - I preferred this over the flow polling a data action (as I will cover in my next newsletter post)
    6. Digital Chatbot then calls a Data Action to retrieve list of books customer wishes to sell based on Live AI conversation


    #Architect
    #DataActions
    #Integrations
    #PlatformAPI
    #WebMessaging

    ------------------------------
    Lucas Woodward
    Winner of Orchestrator of the Year, Developer (2025)

    LinkedIn - https://www.linkedin.com/in/lucas-woodward-the-dev
    Newsletter - https://makingchatbots.com
    ------------------------------



Related Content