Skip to content

Testing Agents

The SipPulse AI platform offers two testing environments to validate your agents before integrating them with production channels like WhatsApp, SIP or web widgets:

  • Chat Playground: Test text-based interactions
  • Voice Playground: Test real-time voice interactions

Accessing the Playgrounds

  1. Navigate to Agents and select an agent
  2. To access the Chat Playground: click on the agent name or ⋮ → Open Chat
  3. To access the Voice Playground: click ⋮ → Voice Playground

Switching Between Playgrounds

On the agent page, use the Chat and Voice buttons at the top of the conversation area to switch between modes.


Chat Playground

The Chat Playground is your sandbox for testing text-based interactions, checking responses and validating agent behavior step by step.

Interface Anatomy

RegionLocationFunction
Conversation ListLeft cornerIndependent histories; useful for testing variations.
Message FlowCenterWhere you chat with the Agent in real time.
Control BarTop sectionManages conversation (new, refresh, close, reopen, information).
Information SidebarRight corner (visible only with the ℹ️ button active)Context metrics, costs, status, model and tools at that moment.

Control Bar

IconActionNotes
New conversationCreates a blank history.
🔄RefreshReloads messages.
Close conversationMarks conversation as Closed. Does not accept new messages until reopened. If there is a Post-Analysis, it runs now.
▶️Reopen conversationAppears only when status is Closed. Allows continuing the interaction.
ℹ️InformationShows/hides the Information Sidebar.

Conversation List

  • Retention: Free plan users keep conversations for 7 days; then they are removed.
  • Visible status: The badge on the right indicates one of four possible states:
    • Pending — waiting for first external interaction
    • Active — open and waiting for response
    • Running — the Agent is generating a response
    • Closed — ended by user or system

Information Sidebar

The Sidebar displays a snapshot of the configurations that the Agent had at the moment the conversation was created. Later changes to the Agent's configurations (model, tools, parameters, etc.) are not applied retroactively — they will only take effect in new conversations.

FieldWhat it shows
Triggered byOrigin channel (for tests: UI). If the channel is external (WhatsApp, SIP), the input field is disabled and chat becomes read-only.
StatusOne of the four states listed above.
ModelLLM used in that conversation (does not change even if the Agent is edited).
ContextTokens used / model limit. Useful to predict context cuts.
Total costSum of input + output tokens converted to currency.
SpeedAverage tokens/s during generation.
ToolsList of available tool calls at the moment the conversation was created.
Post-AnalysisStructured result, if configured and the conversation is closed.

Additional Instructions & Variables

Before the first message you can add additional instructions that are concatenated to the System Instructions for that conversation only.

Usage examples:

  • Pass temporary context: "This conversation is about order #12345."
  • Personalize the conversation: "You are talking to Mariana."

If the agent has variables in its instructions, fill in the values before starting the conversation.


Voice Playground

The Voice Playground lets you test real-time voice interactions. It is ideal for validating agents that will be deployed via SIP or other voice channels.

Prerequisites

To use the Voice Playground, your agent must have:

  1. TTS model configured: Navigate to the Voice tab in the agent settings
  2. TTS voice selected: Choose the desired voice for responses

Required Configuration

The Connect button remains disabled if the agent does not have a voice (TTS) configuration.

Voice Playground Interface

Transcription Area

Displays in real time:

  • Your speech (transcribed automatically)
  • Agent responses (text and audio)

Control Bar

ElementFunction
Allow MicrophoneRequests browser permission (first use)
Mute/UnmuteSilences or activates your microphone
Audio VisualizerShows the waveform of your microphone input
State IndicatorDisplays the current agent state
Connect/DisconnectStarts or ends the voice session

Agent States

During a voice conversation, the indicator shows the current state:

StateColorDescription
IdleGrayAgent is waiting
ListeningGreenAgent is listening to your speech
ThinkingPurpleAgent is processing a response
SpeakingBlueAgent is speaking

Usage Flow

  1. Allow Microphone

    • Click "Allow Microphone" the first time
    • Accept the browser permission prompt
    • The audio visualizer appears when the microphone is active
  2. Connect to the Agent

    • Click Connect to start the session
    • The system connects via LiveKit for real-time audio
    • Wait for the connection to be established
  3. Talk by Voice

    • Speak normally into your microphone
    • Your speech is transcribed automatically
    • The agent responds via audio and text
  4. Disconnect

    • Click Disconnect to end the session
    • The conversation is saved in the conversation list

Session Settings

Click the settings icon to access:

  • Additional instructions: Extra context for this session
  • Variables: Values for the variables defined in the agent

Note

Changes to session settings only take effect before connecting. If you are already connected, disconnect first.


Testing Best Practices

General

  1. Test before production – cover all critical scenarios, exceptions and alternative flows.
  2. Compare models – some tasks work better on larger models; others require lower latency or cost. Create separate conversations for each model and evaluate.
  3. Monitor context and cost – check if the Agent exceeds 75% of the model's token limit; simplify instructions when necessary.
  4. Validate tools – ensure each tool call returns the expected format and that the Agent handles errors (timeouts, empty responses, etc.).
  5. Document learnings – record failures and applied adjustments to build a history of improvements.

Chat Playground

  • Test error scenarios (empty responses, timeouts).
  • Validate behavior with different types of input.
  • Use additional instructions to simulate specific contexts.

Voice Playground

  • Test in a quiet environment for better speech recognition.
  • Validate the agent's response latency.
  • Test different accents and speaking speeds.
  • Confirm that the selected TTS voice is appropriate for the use case.
  • Verify behavior when you interrupt the agent mid-response.

Post-Analysis

When closing a conversation (in either the Chat or Voice Playground), the system automatically executes the structured analyses configured in the Agent. The result appears in the Sidebar for consultation.

For more information on structured analyses, see Structured Analysis.