I built an AI assistant with its own phone number in 10 minutes — here’s how

Earlier this week, ElevenLabs launched Conversational AI 2.0, a massive upgrade to its voice platform that allows anyone to create a human-sounding AI assistant and assign it a real phone number. Unlike many AI assistants that sound like robots, these agents not only sound more human, but can handle interruptions, understand "ums" and "ahs" and respond with sub-second latency.

I decided to test it myself. Here is why I think this shift from chatbots to "phone agents" might just be the next big frontier in AI.

The setup: From prompt to phone number

Building a voice assistant used to require a team of developers and complex SIP integrations. Now, it’s essentially a three-step process that took me less than 15 minutes to configure. Here are the steps I used after going to ElevenLabs and creating an account:

• Define the Brain: Once you navigate to "Conversational AI" on the site (top-hand sidebar), you create an Agent by clicking "Create New Agent." From there, you give the AI a "System Prompt" (e.g., "You are a receptionist for a local bakery"). You can even upload a "Knowledge Base" (like a PDF menu) so the AI knows your specific facts.
• Choose the Voice: This is the cool part — ElevenLabs’ offers a library of 3,000+ realistic voices to choose from. You can also use Professional Voice Cloning to make the agent sound exactly like you.
• Link the Line: Through a native Twilio integration, you can "import" a phone number directly into the ElevenLabs dashboard.

In my test, the result was startlingly natural. When I called my agent, it didn't wait for a beep; it listened for my intent and responded mid-sentence if I interrupted — a feature ElevenLabs calls "State-of-the-Art Turn-Taking."

Quick Info: ElevenLabs Conversational AI 2.0

• Setup Time: 10–15 minutes (with a Twilio account).
• Latency: Feels like a real-time human conversation.
• Languages: Supports 30+ languages including English, Spanish and French.
• Best For: Solo entrepreneurs, customer support, and personal scheduling.
• Pro Tip: ElevenLabs currently offers 15 free minutes of Conversational AI on their Free plan, so you can build and test your agent without spending a dime.

Price Check: What it costs to run

Once you exhaust your free minutes, voice AI is billed by the conversation minute. ElevenLabs recently cut these prices by nearly 50% to stay competitive with OpenAI.

I can see this being a huge cost saving for small businesses on a shoestring budget. For example, a solo contractor can have an AI "receptionist" that answers calls, quotes prices and schedules appointments while they are on a job site. Since this experiment, my husband and I are already considering adding this to his small side business.

I also appreciate that this personal AI is able to take over my calendar without ever looking at a screen — great for getting more done during morning school drop-off.

The takeaway

While this feature is useful (and incredibly cool), this new era is something to be wary of as AI voices grow nearly indistinguishable from human speech. The real challenge shifts from capability to trust.

ElevenLabs says it is strengthening safety guardrails in 2026, but disclosure — making it clear when a caller is speaking to AI — remains less clear. Still, the broader shift is undeniable.

By moving the “AI brain” onto the phone line, tools like this make technology more accessible to people who prefer speaking over typing or want hands-free options. Tools like these give small businesses and entrepreneurs options that used to require an engineering team. Now, they can be built before the morning coffee is done.

What do you think? Is this something you would use in your own life or business? Let me know in the comments.

Follow Tom's Guide on Google News and add us as a preferred source to get our up-to-date news, analysis, and reviews in your feeds.

More from Tom's Guide

• I use the 'reverse brief' prompt to instantly understand any document — here’s how it works
• Claude Sonnet 4.6 is free to use right now — here are 5 things you should try first
• Gemini 3.1 Pro is a powerhouse for deep work — here are 7 prompts that prove it