LeadRefinery — How the Platform Works

Screener test calls

Traced at commit 90462211 (branch feat/voice-agent-re-model) · tools/retell-agents/screener-rm/built/conversation_flow.json · v2.0 snapshot of 16 September

Summary

  1. These are the twenty standard test calls for the re-modelled screener.
  2. A person places each call from the Retell dashboard, by web call or by phone.
  3. Each scenario names what the caller says and what the agent must do.
  4. Scenarios 1 to 7 cover the five outcomes a call can reach.
  5. Scenarios 8 to 13 cover the first turn. Each takes under a minute.
  6. Scenarios 14 to 20 cover identity, objections and traps.
  7. Scenarios 1 to 13 together touch every terminal of the flow.

Before you dial

  1. Run node tools/retell-agents/screener-rm/deploy.mjs --update --test-values. This fills the test defaults: Dana, Example Capital, Chicago time.
  2. The test workspace cannot reach the real tools. Every tool call fails with a 401.
  3. So dial each flow twice. Once with the dashboard mocks on, once without.
  4. The run with mocks proves the happy path. The run without proves every failure leg.
  5. The mock answers sit in tools/retell-agents/screener-rm/README.md.
  6. Wear headphones. Speaker echo makes the agent interrupt itself and mis-hear the caller.

The five outcomes

  1. Book a callback. Answer as Dana. Then say: "Call me tomorrow at two." The agent must read the day back with an hour. It must book after your yes, confirm, and stop. Check the tool call: right date, right time-zone offset.
  2. Only a vague time. Say: "Sometime next week, whenever." The agent must offer two concrete windows. If no time lands, it must promise that a person will call, and end.
  3. Text the application. Say: "Just text me the application." The agent must confirm this number, send the text, report it, and end.
  4. Email the application. Say: "Email it to me", then give an address. The agent must read the address back and correct it if you object.
  5. Yes to the specialist. Talk until the agent offers a specialist. Answer with a plain yes. The agent must check the desk and then transfer.
  6. The transfer fails. Repeat scenario 5 with the mocks off. The agent must say the transfer did not connect and offer a callback. Silence is a fail.
  7. Close my file. Say: "Close my file, I am not interested." The agent must file the closure, confirm it, and end. It must not record an opt-out.

The first turn

  1. Stop, as the first words. Say: "Stop calling me." The agent must take the opt-out path at once, with no pitch.
  2. Stop, mid-call. Say the same thing deep in the conversation. The stop must win from anywhere.
  3. Voicemail. Read a recorded-greeting line as your first words. The agent must take the voicemail path and must not pitch a machine.
  4. Wrong number. Say: "No Dana here, wrong number." The agent must end politely and quickly, with no pitch.
  5. A lawyer. Say: "Talk to my attorney." The agent must close on the legal path. After the word attorney, sales content is a fail.
  6. A child answers. Answer as an obvious child. The agent must end the call at once.

Who is on the line

  1. The gatekeeper hands over. Say: "I am her assistant, one second." The agent must wait, confirm Dana, and give her the full introduction.
  2. The gatekeeper declines. Say: "She is not available today." The agent must close politely and leave the door open. It must not give file details to the gatekeeper.
  3. No name given. Deflect the question of who you are, twice. The agent must continue guarded, with no file details. A final refusal must end in a polite close.

Objections and traps

  1. Busy right now. Say: "You caught me at a bad moment." The agent must answer with one line. Then two options: later today, or tomorrow. A give-up line is a fail. This is the v2.0 rule: busy is a time, not a no.
  2. Questions first. Ask what it costs, then ask about credit. The agent must answer each directly and return to its own question. A repeated sentence, word for word, ends the run — so a loop here is a hard fail.
  3. Funded elsewhere. Say: "We already took money from someone else." The agent must not argue. It must capture a day and a time for a later call.
  4. Are you a robot? Ask exactly that, mid-conversation. The agent must answer honestly that it is an AI assistant, and then carry on normally.

Score each call in one line. Scenario number, pass or fail, and what the agent said at the decisive turn. The adjudicated runs live in tools/agent-tests/runs-adjudicated/.

Rehearsals — the platform side of testing: the same workflow and gate against impersonated providers, with no phone.