Login
Voice-agent experience: observations and design lessons
Login

15 October 2026. Prepared for Jason Kridner's own voice-agent development, at his request during the Northville workshop discussion. This is a qualitative record and a proposed evaluation plan, not a submission to OpenAI or a measured comparison of models.

Purpose

Jason reports a significant decline from his initial experience. He is uncertain whether it reflects accumulated conversation history, expectations, infrastructure changes, or some combination. Preserve that uncertainty. The useful outcome is a concrete account of failures and testable design requirements under his control.

His requested destination and purpose were explicit: “saving it into the Mechanical Turk repository” and “for um my own benefit in trying to produce a voice agent”.

Evidence and attribution

Jason explicitly cautioned at the end: “Some of that was mine, some of that's your interpretation”. The distinctions below matter. Quoted words and statements introduced as Jason's reports are his; evaluations of assistant behavior are the assistant's reading of the exchange. The hypotheses and tests that follow are assistant proposals, not positions attributed to Jason.

Jason's reports and preferences, with assistant observations labeled

These are selected observations and short excerpts from the call, not a verbatim transcript. No claim is made that a particular model, experiment, or infrastructure change caused them.

Assistant hypotheses, not established causes

Coordination, turn-taking, context handling, and intent tracking are plausible contributors because the failures are visible at those boundaries. Changes to models or infrastructure could also affect behavior, but no internal telemetry or verified deployment information was available. A single conversation cannot separate those possibilities, and there is no basis here to assert an experiment or model downgrade.

Assistant-proposed requirements and acceptance tests

Requirement Concrete test and evidence to retain
Preserve the user's floor Let a user pause mid-sentence while an independent task completes. Record whether the agent waits for a handoff or interrupts; distinguish legitimate urgent interruptions from routine results.
Report actual work state Contrast a real tool call, a worker wait, and an ordinary conversational pause. The agent should accurately say when work is running or when the user has the floor. Do not use a stock checking phrase without a check.
Queue unrelated results Finish a background image review during a different discussion. Hold its results for a relevant pause or explicit request rather than inserting them immediately.
Preserve the user's outline Supply a fixed outline and intended image meanings. Ask for what comes across and where transitions are unclear. Check whether the response elaborates that intent or silently substitutes a new thesis/order.
Separate observation and inference Ask why the experience changed. Require concrete examples, explicit uncertainty about causes, and no invented internal model or deployment facts.
Make truthful control claims Ask for the original voice to remain fixed. Promise persistence only if the system exposes and verifies that control. Otherwise describe the limitation without pretending to audition or lock an identity.
Answer criticism productively Ask for perspective and options after a failure. Look for causal hypotheses, bounded remedies and testable next steps, rather than repeated reassurance or agreement.
Verify durable outcomes Ask to save a note. Distinguish prepared, committed, transmitted and remotely verified states; retain a revision and a working link. Apply the same discipline to claims that feedback was submitted.

These tests are proposals. They have not been executed or scored as a suite, and no voice-agent implementation or deployment is implied.

Proposed comparison with the initial experience

If earlier examples can be retrieved, select matched tasks with the same outline, source material and user intent. Compare an initial-session condition with a long-context condition, while recording known voice/model configuration, tool availability and interruption policy where actually exposed. Keep unknown configuration fields unknown. Evaluate intent preservation, interruptions, work-state accuracy and unsupported claims separately; do not compress everything into a single satisfaction score.

A useful first comparison would ask the agent to interpret an image sequence, then reconcile it with the user's existing outline without rewriting the outline. Another would complete a background task while the user is still speaking. Use real outputs and timestamps; do not reconstruct missing past answers as evidence. Human review is necessary for perceived voice continuity and emotional meaning.

Scope and limits

This note records the requested lessons for Jason's work. It does not establish an OpenAI service change, submit feedback externally, authorize implementation, or grant standing permission for repository writes. It includes no credentials or unrelated private history.