In this video: I clone my voice in under a minute and use it to build an AI agent that can answer my business phone 24/7, pull answers from a custom knowledge base, and book callers straight into my calendar — all without sounding like a robot. We also get into outbound cold calling campaigns, text-to-speech for video narration, and dubbing the same voice into other languages. Everything is built inside Smallest AI, and you can follow along completely free.
CHAPTERS: 0:00 What This AI Voice Agent Can Do 0:24 In This Video 0:48 Why AI Voice Solves Business Bottlenecks 1:36 What is Smallest AI? Lightning + Adams Platform 1:52 Why Use Smallest AI (Latency, SDKs, Compliance) 2:37 How to Try Smallest AI for Free 3:01 Smallest AI Dashboard Walkthrough 3:18 Demo 1: Voice Cloning with Smallest AI 3:52 Recording Your Voice to Clone 4:10 Instant Voice Clone Created 4:25 Testing and Adjusting the Cloned Voice 4:55 Demo 2: Building an Inbound AI Voice Agent 5:57 Setting Up a Knowledge Base for Your Agent 6:53 Creating a Voice Agent from Templates 7:19 Single Prompt vs Conversational Flow Agents 7:31 Writing the Voice Agent System Prompt 8:01 Using Claude to Expand the Agent Prompt 8:32 Connecting Cloned Voice and Knowledge Base 8:56 Live Test: Calling the AI Voice Agent 9:36 Publishing the Agent & Transfer Call Feature 9:59 Setting Up Outbound AI Cold Calling Campaigns 10:40 Demo 3: Text-to-Speech for Video Narration 11:10 Multi-Language Voice Cloning (Spanish Dubbing) 11:42 Analytics and API Access for Developers 12:12 Recap: What We Built 12:27 Try Smallest AI for Free
------------------- Clips channel @jonlawclips
I do NOT sell any products of my own. Watch out for scams.
What's the price for the sprint a month?
Yeah, so this agent that I just talked to on the phone
knows everything about my business.
It sounds like me and it can book anyone who calls
into my calendar for a demo.
And that is exactly what we're going to do in this video.
Whether you work for yourself or someone else,
I'm going to show you exactly how to clone voices
and then build AI agents using those voices
to go do real practical things for your business,
whether inbound or outbound.
If you have never dealt with AI voice,
I promise this is going to be a value add
for you or your business.
This will be a clean video.
We'll just jump straight into demos.
So that's what's coming up.
I appreciate your time and being here and let's go.
So first, I think the appeal with AI voice
is that the inherent bottleneck in a lot of businesses
is a specific person's voice or time.
For example, in a content business,
the big bottleneck is me being able to sit down
and be in front of a camera.
Same thing with a secretary or a business owner,
that kind of voice or personality is expected
to be on the other side of the phone.
And if that person or when that person
isn't there to pick up the phone,
you're actually losing money, right?
You're losing leads or not building relationships
that could otherwise be built.
So that's the promise of AI voice.
If you can replicate someone's voice,
if an agent can sound human
and knows everything about your business,
then you solve that bottleneck
and you open up this whole world of opportunity.
So that leads us to this video
and the workflow that I want to walk through
to solve that problem.
And we're doing that on a platform called Smallest AI.
If you haven't heard of them,
they basically, and these guys have kind of
two core products that work together.
The first is Lightning, that's a text to speech
and voice cloning engine.
And then the second is Addins,
which is their AI voice agent platform.
Now the advantages of Smallest
and why we're using them for this video
is first off the cloning speed
and the ease of use for that just setup kind of workflow.
Number two, the latency on this thing,
and you'll hear it in a minute, is really good.
So if you're actually talking to the agent over the phone,
there's no lag and it can go pull from a knowledge base
or basically context about your business
or your services really, really, really fast.
And that is what kills nearly all of the AI voice solutions
that are out there for businesses.
And then on the builder side,
the API setup and the Python and JavaScript SDKs,
all of that is A plus.
So you can integrate all of that into your workflows
if you're a developer.
And if not, again, it's extremely user-friendly.
And they're SoC2, PSI, and HIPAA compliant
if you happen to be an enterprise listener.
So that in mind, we're gonna jump into the first demo.
Now, if you wanna follow along
and support the channel while doing it,
so just actually build while I'm building in real time,
I suggest you do that because you'll learn better that way.
And you can get started completely for free.
You do not have to pay anything to go and just sign up
and then follow along with what I'm doing in this video.
If you don't want to, no worries at all.
Either way, let's get into demo number one.
Okay, guys, so I set up a demo account here.
This is the dashboard at smallest.ai.
As far as usability goes, it is a very friendly platform.
We're gonna dive into a few of the core applications here.
A major one that I'm excited to show you are the agents.
But first I wanna do something a little bit fun
just to demonstrate how far AI voice has come
and the quality of the voice agents here.
And that's going to be voice cloning.
So let's jump into the voice cloning tab right here.
And then we'll go ahead and click create a voice clone.
So if you do anything on social media,
let's say you're making a video, you need a voiceover,
you're creating ads for your boss,
whatever it may be, something like this
is a basic workflow to sit down, process for you,
your boss, your team, your business.
And once you set it up once,
then you can use that for absolutely anything in the future.
Let's click next.
And then I'm going to live record this audio
using this sentence they recommend here.
I don't need a 10 to 20 minute long audio clip.
All I need to do is read this sentence in the browser
and then I can clone it.
My favorite time of year is summer.
Okay, now I'll enter the details.
Let's just call it John clone.
And then I'll click finish.
Okay, now it's already done.
That was created instantly.
Let's click use right here.
And then now let's say welcome to the channel
where we make videos about AI entrepreneurship
and personal finance.
And let's click generate.
Welcome to the channel where we make videos
about AI entrepreneurship and personal finance.
What I usually recommend for AI voice as well
is make it a little faster.
So we're going to set this for 1.2.
Welcome to the channel where we make videos
about AI entrepreneurship and personal finance.
And so there we go.
It's the tonality, the pacing,
and the pauses or the breaks, I think,
that you really want the model to match.
So we have our voice clone.
That is demo number one, super easy.
Takes three minutes to do.
But now I want to jump into demo number two.
And that is the first real soup to nuts
commercial AI voice application
that you can plug and play into your business.
And imagine this.
Instead of calls going to voicemail
outside of your business hours,
let's say it's 9 p.m.
You want to be with the kids.
Instead of that call just going to voicemail,
the person who picks up the potential customer
that's calling the phone line for your business
can talk to a frontier intelligent AI
that knows everything about your business,
your hours, your pricing, your services, etc.
It can go ahead and close them, right?
It can set an appointment in your calendar.
It can send them a text for confirmation.
And best of all, it sounds exactly like you
or like an assistant or secretary
or whoever during regular business hours
would actually be picking up the phone.
So that is the workflow that we're going to go ahead
and set up here.
And we're going to use the agents tab to do that.
And so we'll build a voice agent that can handle calls.
And then we're going to integrate it
into the voice we just created.
And critically, before we even get here,
we're going to set up the knowledge base.
And that's in this little portal right here.
Now, knowledge base is the information
that you want the voice agent to have.
So again, things like your pricing,
general context on the business,
your services, client case studies,
whatever you want the AI to know.
And the more, the better.
We're going to give that information to it here.
Let's go ahead and click create a knowledge base.
We'll call it my business.
I'll click create.
Then we'll click plus.
Then I'll click into the knowledge base
and then add documents.
And so what I'd recommend is just
any one pager type information you have,
any brief, any presentations you've given to people,
go ahead, upload them right here.
So I have a sample one pager here for a business.
Let's say you're a marketing consulting business.
So there's information here like your selected clients,
your booking, email, and link, the pricing, and so on.
So for this demo, that is the document.
I'm going to upload into the knowledge base.
So we have our knowledge base.
We have our phone voice.
Now we can jump into the agents.
Let's go ahead and click create.
And now here we have a few options.
If we click start with template,
we can see all kinds of agents
that are already set up here.
So what I recommend you do is
just start with this template page
and then search for your kind of business.
For example, if you work in insurance,
here are nine different agents
that are pre-set up for you.
So that's great if your business is there
in a pretty common one.
For sake of the demo,
let's go ahead and click start from scratch.
And this will be easy.
We'll set it to single prompt.
Conversational flow would be more sales oriented.
So for example, like we're doing outbound.
And so then I'm going to go ahead
and click create draft.
So what we're editing here
is the core prompt for the voice agent.
It's basically an instruction manual
where you're telling it what you want it to do.
So what I'm going to do, I'm going to draft.
You are a voice agent that handles inbound calls
to my business phone number
and using the knowledge base
helps answer questions politely
and guide callers for booking a call.
So what I'm going to do,
I'm going to go ahead and take this.
I'm going to jump to Claude
and then say expand this system voice agent prompt
to be more thorough.
Now we can see here Claude generated
a much more thorough version of this.
You can write it manually if you want to.
But Claude basically just knows
the best practices for this.
So this includes things like hard rules
for the voice agent,
like, hey, never lie about the business,
never hallucinate or make things up.
And then we have a set of other guidelines as well.
And there's a lot more information here.
I've gone ahead and copied it.
Now I'm just going to go ahead and paste that here.
Now we're going to connect everything we just set up.
So under Daniel or the voice portal,
I'll click on Claude.
I'll add my own voice.
And then I'm going to turn on
the knowledge base right here.
I'll click add knowledge base
and then I'll select the one we just set up.
Let's click save function.
And so now our knowledge base is connected.
Our cloned voice is connected
and we have the rules essentially
for the agent to follow.
And now let's click test agent.
I'm going to call myself.
Now here's the call.
Let's go ahead and pick that up.
What's the price for the sprint a month?
And so there we go.
I mean, you can hear the quality of that.
That sounds like a person.
It's really good quality voice.
And I got that information correct,
including the little piece of false information
I gave it like, hey, what's the monthly price?
When really it's a flat price.
And I pulled that directly from here
without a super long delay.
So that works.
Let's go back.
Let's click on publish.
We can see all the changes that were made here.
I'll click publish and activate.
And there we go.
It is fully live.
Now one other feature I want to double click
on is transfer call.
And so what this can do is it can give it the power
to transfer the call to someone else.
That just depends on the structure of your business
and whether you want it to do that
or just give people information
and book them in itself.
Now that was an inbound agent.
So it handles calls to your business.
You can also do outbound.
You can cold call with voice agents.
That's a very similar flow.
You can click create agent.
If we went to the templates, for example,
we can see, for example, outbound calls right here.
And then to deploy that, right,
we can have our audiences here.
We can organize them into campaigns.
Basically, you can set up whole cold calling
sales sequences within the smallest platform.
And so that's pretty incredible.
There's a lot of potential there.
And the way you do it is exactly the same demo
we just went through,
except the agent is designed to close people
into some kind of, again, booking system,
email, whatever it is that you're trying
to get from the people.
And then for the quick demo number three here
that I want to show you,
that's just going to be text to speech.
And so what I have here is a script
for a YouTube integration.
And let's just say we wanted to generate
this whole thing, this entire thing with AI.
We can do that very easily.
I have a John clone voice right here.
We have set it.
Let's click generate.
Now, before we get back to the video,
made it this far, I think you'll like as well.
But then what's really cool about this,
and again, a workflow that I love
once you have a clone voice
is you can do this in different languages.
So let's also say that you want to dub a video
or you want it just created in,
let's say an ad created in a different language.
Let's jump back into Clot.
I'm going to say, translate this to Spanish.
Now we'll go ahead and copy this.
Let's paste it in.
And then we can click generate.
So the voice tonality, the pacing will sound the same,
but the language will be different.
And so there we go.
We have our voice cloning
to make everything else possible.
We have our text to speech.
And then we have the voice agent
that we went ahead and created
for inbound and also potentially outbound.
Now, as a last note on the platform,
all the analytics are going to be housed right here.
That's going to be really useful
if you're talking about things like the agents
where they're 24 seven taking calls for your business
or they're making, right?
You're running marketing campaigns
for making thousands or tens of thousands
of calls a day on your behalf.
And then also you can run all of this programmatically
if you prefer that and or integrate things
like the analytics and the data into other platforms.
For that, just grab your API key here.
And that is what I wanted to show you
about smallest.ai.
So to recap, we built a voice clone
from 15 seconds of audio
and outbound agent to handle phone calls 24 seven
and then video narration in multiple languages
using my own voice.
So pretty cool again.
And like I said,
if you do want to follow along
and support the channel
and build anything that we just looked at,
then you can get started completely for free
at this link on the screen
or the link in the description.
If you work in content period
and you haven't touched AI voice,
then I promise you won't regret it.
You can try this all completely for free.
Just give it a test drive and go build something cool,
make yourself more productive,
make yourself some money.
And that of mine,
I appreciate y'all being here
and I will see you in the next one.