Voice AI platform features compared: testing, monitoring, telephony, and integrations

Most voice AI comparisons start and end with the per-minute price. This one does not. Once a phone agent answers real customers, the deciding questions are operational: How do you test a change before it reaches callers? How do you know a deployed agent is behaving? Can it use your existing phone numbers? What happens on a transfer or a voicemail? How does it connect to the rest of your stack?

This guide compares ThunderPhone, Retell AI, Vapi, and Bland AI on those five dimensions. Every competitor fact is drawn from that vendor's own public site or documentation, cited inline, and was re-checked on August 18, 2026. Where the reviewed sources do not establish a competitor capability, the row says so plainly — absence of a public claim is not evidence a capability is missing, only that a buyer should ask.

Testing and simulation

Pre-launch testing is where the four platforms differ most visibly in their public documentation.

Provider Documented testing capabilities
ThunderPhone Browser mic tests, AI-caller simulations, bot-to-bot and SIP-loopback test calls, reusable scenarios with grading, regression suites with minimum pass-rate gates, CI execution, and live-traffic A/B experiments. Simulations are billable real calls; the interface shows the charge before a run.
Retell AI Simulation testing is documented, with test cases, batch runs, and mocks. Retell simulation-testing docs, accessed 2026-08-18.
Vapi Test Suites use an AI tester that chats with or calls an agent from predefined scripts, then evaluates the transcript against success criteria. Chat and voice tests are available, voice tests include recordings, and each test is capped at 15 minutes; test calls bill like regular calls. Vapi Test Suites and voice-testing docs, accessed 2026-08-18.
Bland AI The homepage shows scenario testing with pass/fail tracking. Bland homepage, accessed 2026-08-18. Suite, CI, or experiment behavior beyond that is not established from the reviewed public sources.

Two distinctions matter when reading this table. The first is simulation realism. ThunderPhone's bot-to-bot and SIP-loopback tests place actual calls through the same path production traffic uses, which is why they are billable — the test exercises telephony, not just the conversation model. Vapi's voice tests similarly run on a real phone call and bill like regular calls. The second is release discipline. ThunderPhone documents regression suites with minimum pass-rate gates and CI execution, so a failing scenario set can block a release, plus live-traffic A/B experiments after launch. The reviewed Retell, Vapi, and Bland sources do not establish pass-rate release gates, CI integration, or live-traffic experimentation; teams that need those should ask each vendor directly.

Monitoring and quality assurance

After launch, the question shifts from "does it work?" to "is it still working, on every call?"

Provider Documented monitoring and QA
ThunderPhone Graded call logs with transcripts and recordings, alongside the reusable graded scenarios and regression suites used in testing.
Retell AI Post-call analysis is listed, and AI quality assurance is available as a paid add-on at $0.10/minute after the first 100 free minutes. Retell pricing, accessed 2026-08-18.
Vapi The homepage states real-time monitoring and tracking what's working across every call. Vapi homepage, accessed 2026-08-18.
Bland AI Teams can watch calls in real time for quality assurance. Bland homepage, accessed 2026-08-18.

These are different QA philosophies rather than rankings. Bland emphasizes watching live calls as they happen, and Vapi states real-time monitoring across calls; Retell prices automated per-minute call scoring as an add-on; ThunderPhone builds grading into call logs, so live traffic is reviewed as graded records rather than raw recordings. Note the cost shape too: Retell's AI quality assurance is metered per minute after its free allowance, while the reviewed sources do not establish separate QA metering for the other three.

Telephony and phone numbers

Telephony determines whether a platform can slot into the phone infrastructure a business already owns.

Provider Documented telephony and number options
ThunderPhone Inbound demo U.S. numbers for testing (inbound-only, not intended for production). Production numbers can be brought through supported direct VoIP connections or manual SIP configuration for any SIP trunk; verified imported numbers support inbound and outbound calling.
Retell AI Connect any telephony through SIP trunking and use existing numbers or VoIP providers; phone numbers are $2/month, standard telephony $0.015/minute varying by country, with no charge for SIP trunking. Retell homepage and pricing, accessed 2026-08-18.
Vapi Bring-your-own SIP trunks through documented provider paths or a generic integration with any SIP provider using gateway and authentication details; docs warn that IP-based authentication can cause routing issues on shared infrastructure. Free Vapi phone numbers are U.S.-national only, up to 5 per account. Vapi SIP docs and phone-calling docs, accessed 2026-08-18.
Bland AI Bring your own telephony via Twilio or SIP trunks, or use Bland's built-in Twilio-based connection at pass-through cost; bring-your-own-telephony customers do not pay transfer fees. Bland pricing, accessed 2026-08-18.

All four document a bring-your-own path, so the decision rests on details. Teams with an existing trunk should confirm the generic path works for their carrier; teams starting from zero should compare starter economics — Vapi's up-to-5 free U.S. numbers, Retell's $2/month numbers, Bland's pass-through carrier cost, and ThunderPhone's demo numbers, which are for testing only. Finally, confirm call direction: ThunderPhone states verified imported numbers support both inbound and outbound; direction eligibility elsewhere should be validated during onboarding.

Transfers and call handling

Real phone traffic hits voicemail, waits on hold, routes through keypad menus — and some calls must reach a human.

Provider Documented call-handling behavior
ThunderPhone Cold and attended warm transfer. In warm mode, the caller waits on hold while the agent privately briefs the recipient, connects after acceptance, and returns to the caller with the outcome if the recipient declines, misses the call, or reaches voicemail. Voicemail detection can prompt-decide, hang up, or leave a configured message; campaigns can retry voicemail outcomes. Hold is handled at a flat 2¢/minute; keypad phone-menu navigation is supported at the engine rate. Warm transfer requires an eligible production number that can place an outbound SIP leg; demo numbers and browser calls are limited to cold transfer.
Retell AI Transfer, voicemail, hold, and menu-navigation behavior is not established from the reviewed public sources.
Vapi Transfer, voicemail, hold, and menu-navigation behavior is not established from the reviewed public sources.
Bland AI Transfer minutes are priced at $0.05/$0.04/$0.03 per minute by tier, waived for bring-your-own-telephony customers, which establishes transfer support; the mechanics (warm versus cold, voicemail handling, menu navigation) are not established from the reviewed public sources. Bland pricing, accessed 2026-08-18.

This is where the reviewed research is thinnest for competitors; treat the empty rows as homework, not verdicts — the research pass focused on pricing, compliance, languages, and testing pages, and transfer mechanics may be documented elsewhere. What the comparison does establish is what to ask every vendor: Is transfer warm (briefed handoff) or cold (blind)? What happens when the target doesn't answer? Can voicemail outcomes trigger a retry? How is hold billed? Can the agent navigate an IVR keypad menu? ThunderPhone publishes answers to each, down to billing — hold at a flat 2¢/minute, voicemail and menu navigation at the engine rate, straight-to-voicemail calls capped at one minute.

Integrations: webhooks, MCP, knowledge, and web

Four integration surfaces matter most: event delivery, tool connectivity, knowledge grounding, and the web channel.

Provider Documented integration surface
ThunderPhone Webhooks: multiple endpoints with per-endpoint secrets and event subscriptions, HMAC-SHA256 request signatures, non-blocking delivery with exponential-backoff retries, and blocking incoming-call configuration events. Tools: remote MCP servers added by URL over streamable HTTP, with automatic tool discovery and static-header support. Knowledge: a document library accepting text, Markdown, CSV, PDF, and DOCX uploads — 5 MB per text file, 50 MB per PDF or DOCX — with URL import, content search, per-agent scoping, and a mid-call knowledge search tool. Web: an embeddable voice widget with React and script-tag installation, domain allowlists, origin-locked publishable keys, and the same transcript, recording, and grading data as phone calls.
Retell AI A knowledge base is available as a priced add-on at +$0.005/minute. Retell pricing, accessed 2026-08-18. Webhook, MCP, and web-widget capabilities are not established from the reviewed public sources.
Vapi Webhook, MCP, knowledge-base, and web-widget capabilities are not established from the reviewed public sources.
Bland AI Pricing lists knowledge-base allowances by tier (for example, 10 knowledge bases on the Start tier). Bland pricing, accessed 2026-08-18. Webhook, MCP, and web-widget capabilities are not established from the reviewed public sources.

Again, sparse competitor rows reflect the scope of the reviewed research, not proven gaps — these platforms target developers, and integration surfaces likely exist beyond the pages reviewed. The checklist to run against any vendor: Are webhook payloads signed, and how? What is the retry policy on failed deliveries? Can external tools be attached through an open protocol such as MCP rather than a proprietary format? What file types and sizes can the knowledge base ingest, and can it import from a URL? And if a web voice channel matters, is embedding restricted by domain allowlist so a publishable key can't be lifted onto another site?

FAQ

Which platform has the most complete documented testing workflow?

From the reviewed public sources, ThunderPhone documents the widest span — browser tests through simulations, graded regression suites with pass-rate gates, CI execution, and live A/B experiments. Vapi documents scripted chat and voice tests with recordings, LLM evaluation, and a 15-minute cap; Retell documents simulation testing with batch runs and mocks; Bland shows scenario pass/fail tracking. Vapi Test Suites, Retell simulation-testing docs, Bland homepage, accessed 2026-08-18.

Do test calls cost money on these platforms?

On the two platforms that publish an answer, yes. ThunderPhone's simulations are billable real calls, with the charge shown before a run; Vapi's docs state test calls bill like regular calls. Vapi Test Suites, accessed 2026-08-18. Test-call billing for Retell and Bland is not established from the reviewed sources.

Can I watch or review live calls on each platform?

Each publishes a different mechanism. Bland states real-time call watching for QA, Vapi states real-time monitoring across calls, Retell lists post-call analysis plus paid AI quality assurance, and ThunderPhone provides graded call logs with transcripts and recordings. Bland homepage, Vapi homepage, Retell pricing, accessed 2026-08-18.

Can I bring my own phone numbers and SIP trunk to all four?

All four document a bring-your-own telephony path. ThunderPhone supports direct VoIP connections or manual SIP configuration for any trunk, with verified imported numbers handling inbound and outbound; Retell states any telephony connects through SIP trunking; Vapi documents a generic integration with any SIP provider; Bland supports Twilio or SIP trunks alongside its built-in Twilio-based option. Retell homepage, Vapi SIP docs, Bland pricing, accessed 2026-08-18. Confirm number eligibility and call direction before migrating.

Which platforms support warm transfer and voicemail handling?

ThunderPhone publishes both: attended warm transfer with a private briefing step, and voicemail detection with prompt-decide, hang-up, or leave-a-message options plus campaign retries. Bland's tiered transfer-minute pricing establishes that transfers exist there, but warm-versus-cold mechanics are not established from the reviewed sources, and no transfer or voicemail behavior is established for Retell or Vapi — ask each vendor directly. Bland pricing, accessed 2026-08-18.

How do compliance postures factor into a feature comparison?

Feature depth and compliance posture are separate axes; both belong in a shortlist review. ThunderPhone's public posture is GDPR and HIPAA compliant, with customers responsible for configuring workflows, data handling, recordings, integrations, and notices for their own obligations; the sibling head-to-head comparisons cover each competitor's stated posture. No platform label replaces assessing your own configured deployment.

Sources and freshness

ThunderPhone pricing and product details reflect its published pricing and documentation as of August 19, 2026. Every Retell, Vapi, and Bland claim on this page was checked against the vendor's official pages linked beside it, on the accessed dates shown. This comparison is documentation-based — no competitor account, invoice, or live call was tested — so "not established from the reviewed public sources" means exactly that, not that the capability is absent. These vendors change documentation and pricing frequently; confirm every claim against the live vendor pages before relying on it.