• Skip to main content
  • Skip to header right navigation
  • Skip to site footer
  • About
  • Contact
  • Subscribe
  • Advertise
method logo sxs 280x96 wht

methodshop

tech news, reviews & how to's

  • Trending
  • Latest
  • Tech
    • Apps
    • Internet
    • Software
    • Security
    • Games
    • Advertising
  • Life
    • Entertainment
    • TV & Film
    • Music
    • Health & Science
    • Family
    • Social Media
    • Food
    • Style
  • Learn
    • Tutorials
    • Reviews
    • News
      • Business
      • Crime
      • Politics
  • Fun
    • Featured
    • Humor
    • Holiday

Home : Software : Microsoft’s VALL-E AI Can Imitate Any Voice (Even Yours) Using Just A Three-Second Sample

voice hackers
voice hackers

Microsoft’s VALL-E AI Can Imitate Any Voice (Even Yours) Using Just A Three-Second Sample

Microsoft's VALL-E AI can replicate any voice, including the emotions and tone of a speaker, using just a three-second sample.

Jan 11, 2023 by Joe Michaels
FacebookTweetPinLinkedIn
Table of Contents[Hide][Show]
  • How Does The Microsoft VALL-E AI Work?
  • Why Does The VALL-E AI Sound So Human-Like And Natural?
  • VALL-E AI Can Even Replicate Emotions
  • Should Voice Actors Be Concerned?
  • How Easy Would It Be To Steal Your Voice?
  • Are You Worried About AI Voice Hackers?+−
    • NANDOBOT? Are Robo-Reporters Coming To A Newsroom Near You?
    • 20 Short And Funny Out Of Office Messages Generated By The ChatGPT Chatbot
    • 40 Fun Things To Ask Alexa About Christmas
    • Why Apple Is Pulling The “Hey” Out Of Their “Hey Siri” Wake Words
    • These Researchers Taught A Robot How To Peel A Banana Like A Human
    • Have You Seen The Whisper Film? The Real Villain In This Scary Short Film Is Amazon’s Alexa.
    • 30 Useful And Funny Things To Ask Alexa About Christmas
    • VIDEO: Computer Program Teaches Itself To Beat ‘Super Mario World’ Video Game
    • Warning! This Rude Santa Bot Might Ruin Your Christmas.
Reading Time: 3 minutes

  • Microsoft recently launched an AI tool called VALL-E that can create highly realistic replications of people’s voices.
  • The Microsoft VALL-E AI is able to generate content using only a 3-second recording as a prompt.
  • One of the key features that differentiates VALL-E from other AI models is its ability to replicate the emotions of a speaker, enabling it to create highly convincing audio replications.

Microsoft has developed a new text-to-speech artificial intelligence model, called VALL-E, that can mimic a person’s voice in just three seconds. VALL-E is able to generate audio of a person saying anything once it has learned a specific voice, and its ability to accurately mimic voices stunning. Should we all be worried?

How Does The Microsoft VALL-E AI Work?

The researchers at Microsoft refer to VALL-E as a “neural codec language model.” It utilizes Meta‘s EnCodec, an AI-powered audio compression technique, to create its functionality. Unlike traditional text-to-speech tools, which synthesize speech by manipulating waveforms, VALL-E analyzes the unique characteristics of a person’s voice and decomposes them into individual components known as “tokens”. It then uses this training data to generate the final waveform.

How The Microsoft Vall-E Ai Works
How The Microsoft VALL-E AI Works (GitHub)

This allows VALL-E to make different voices and sounds for different things like audiobooks, videos and more. It’s kind of like a magic wand for making computer voices sound better. The final result is a new way of making computer voices sound more like real people.

Why Does The VALL-E AI Sound So Human-Like And Natural?

Unlike other text-to-speech or AI-powered speech tools, VALL-E sounds very natural, and almost human. How was Microsoft able to achieve this?

Microsoft trained VALL-E’s speech synthesis capabilities on 60,000 hours of English speech from over 7,000 speakers, using an audio library called Libri-light assembled by Meta. The quality of the audio generated by VALL-E is directly proportional to how closely the three-second sample matches the training data.






Microsoft'S Vall-E Ai Can Imitate Any Voice (Even Yours) Using Just A Three-Second Sample - Valle Librispeech Samples 1
Microsoft VALL-E LibriSpeech Samples via GitHub

Cornell University published a paper on how they were able to use VALL-E to synthesize several voices and Microsoft posed some incredible samples on GitHub. Take a listen for yourself. The quality varies and some samples sound natural while others may be more robotic.

VALL-E AI Can Even Replicate Emotions

VALL-E sets itself apart from other AI tools with its capability of reproducing the emotion and tone of a speaker, even when generating audio of words that were never spoken by the original speaker. In addition, it also able to replicate the acoustic environment, creating an authentic and realistic imitation of the speaker.





The VALL-E AI has been trained on more than 60,000 hours of English speaking audio and can replicate emotion as well as natural sounds. #artificialintelligence #valle #ai #aivoice #voiceai #voicehackers
Click To Tweet

Should Voice Actors Be Concerned?

Podcasting Microphone
Ivsu

As technology advances, voice actors may face competition from VALL-E and similar technologies. While this may result in loss of work for some, it is likely that companies will adopt these technologies if they are able to replace the need for human voice actors in areas such as audio books.

Apple is already reportedly working on using voice AI tools for audio book narration. Should voice over professionals be worried?

“AI is at its infancy, but growing rapidly. We’re at a seminal moment, but AI voice tech doesn’t have to be scary for voice actors,” revealed Bonnie Optekman, a non-union voice over artist in New York City. “There might be some lost work but there is also new opportunity. Voice actors should be educating themselves now on what future the opportunities are, what compensation should be, and how to protect themselves.”

How Easy Would It Be To Steal Your Voice?

If you aren’t already a little concerned, you should be. Even Microsoft is concerned. That’s why they have not made VALL-E available like ChatGPT.

Just imagine what someone could do with one of your voicemails. In the wrong hands, VALL-E can be used to….

  • Create authentic-sounding spam calls from people you know.
  • Fabricate scandalous recordings of politicians or other public figures, like celebrities.
  • Call your boss and quit your job.
  • End a relationship.
  • Place financial transactions. Many banks use voice confirmation. That will obviously have to change very quickly.

Are You Worried About AI Voice Hackers?

How concerned are you about AI voice hackers? What do you think criminals or your enemies would do with your voice if they could recreate it? Let us know in the comments.

Three seconds, that’s all it takes for Microsoft’s new text-to-speech VALL-E AI technology to mimic a person’s voice. Should you be worried? #artificialintelligence #valle #ai #aivoice #voiceai #voicehackers
Click To Tweet
Robot Dunce Cap

NANDOBOT? Are Robo-Reporters Coming To A Newsroom Near You?

Read moreNANDOBOT? Are Robo-Reporters Coming To A Newsroom Near You?
Artificial Intelligence Emails

20 Short And Funny Out Of Office Messages Generated By The ChatGPT Chatbot

Read more20 Short And Funny Out Of Office Messages Generated By The ChatGPT Chatbot
Ask Alexa Christmas

40 Fun Things To Ask Alexa About Christmas

Read more40 Fun Things To Ask Alexa About Christmas
Woman Hey Siri Iphone Ai

Why Apple Is Pulling The “Hey” Out Of Their “Hey Siri” Wake Words

Read moreWhy Apple Is Pulling The “Hey” Out Of Their “Hey Siri” Wake Words
Robot Banana Peel

These Researchers Taught A Robot How To Peel A Banana Like A Human

Read moreThese Researchers Taught A Robot How To Peel A Banana Like A Human
Amazon Echo Scary

Have You Seen The Whisper Film? The Real Villain In This Scary Short Film Is Amazon’s Alexa.

Read moreHave You Seen The Whisper Film? The Real Villain In This Scary Short Film Is Amazon’s Alexa.
Alexa Christmas

30 Useful And Funny Things To Ask Alexa About Christmas

Read more30 Useful And Funny Things To Ask Alexa About Christmas
Mario Program Code

VIDEO: Computer Program Teaches Itself To Beat ‘Super Mario World’ Video Game

Read moreVIDEO: Computer Program Teaches Itself To Beat ‘Super Mario World’ Video Game
Santa Bot Screenshot

Warning! This Rude Santa Bot Might Ruin Your Christmas.

Read moreWarning! This Rude Santa Bot Might Ruin Your Christmas.

T


FacebookTweetPinLinkedIn
Category: Software, Technology Tag: Artificial Intelligence, Microsoft
Previous Post:nice pondsHow Farmers Use Colored ‘Pond Dye’ To Keep Water Safe From Algae
Next Post:NANDOBOT? Are Robo-Reporters Coming To A Newsroom Near You?robot dunce cap

Reader Interactions

Leave a Reply

Your email address will not be published. Required fields are marked *

Sidebar


Popular Posts

robot reporter

Job Automation Using ChatGPT Could Make These Jobs Obsolete – Is Your Job On This List?

nbc chimes feature scaled

The Surprising Story Behind The NBC Chimes

lg tv disable home screen scaled

How To Change The Default LG TV Home Screen To Live TV

google naked

7 Pictures Of Naked People Captured By Google’s Cameras

sleepless bear

20 Famous People Who Are Members Of The Sleepless Elite

Caddyshack Quotes

30 Famous Caddyshack Quotes That’ll Make You Laugh

harrypotter sex

Controversial Nimbus 2000 Vibrating Harry Potter Broomstick Has Parents In An Uproar

dvd rewinder scaled

The Amazing DVD Rewinder: Be Kind And Rewind Your… DVDs?!

rooftop woman

10 Naked Sunbathers Busted By Google Earth

dmas top usa

Top 200 Nielsen DMA Rankings (2023) – Full List


Categories

Advertising Apps Business Crime DIY & Tutorials Entertainment Family Featured Food Games Health & Science Holiday Humor Internet Learn Life Music News Politics Reviews Security Sex Social Media Software Style Technology Travel TV & Film Uncategorized



Intense woman listening to AM radio with headphones

7 Reasons To Save AM Radio In Cars

Here are some important reasons to save AM radio.


There's no AM Radio In Tesla Cars

Why Electric Car Manufacturers Want To Kill AM Radio

Video killed the radio star, but electric cars will kill AM radio. Here's why EV manufactures want to kill AM radio.


Recent Posts

Intense woman listening to AM radio with headphones

7 Reasons To Save AM Radio In Cars

electromagnetism, frequency, radiation, Electromagnetic frequencies

5 Things Blocking The Efforts To Save AM Radio

There's no AM Radio In Tesla Cars

Why Electric Car Manufacturers Want To Kill AM Radio

The ChatGPT iOS App on an iPhone

OpenAI’s ChatGPT iOS App Is Now Available For iPhone, iPad

Cute Baby Wrapped In A White Towel

The Top 100 Most Popular Baby Names Over The Last 100 Years (1923-2022)

Caddyshack Quotes

30 Famous Caddyshack Quotes That’ll Make You Laugh

what does dna stand for

What Does DNA Stand For (Do You Know The Answer)?

Tutorial on how to remove your info from FastPeopleSearch

How To Remove Your Info From FastPeopleSearch

maxresdefault 25

Incredible Mashup Of All The Inception Dream Layers In Real Time

matrix red pill and blue pill

The Symbolizm Of The Matrix Pill Scene

Jump to comments

About

MethodShop’s mission is to entertain, inform, and sometimes gross you out. MethodShop has affiliate relationships, so we may get a small share of the revenue from your purchases. Items are sold by the retailer, not by us. All prices are subject to change.

Follow

  • Facebook
  • Twitter
  • Instagram
  • YouTube
  • Pinterest

Trending Posts

robot reporter

Job Automation Using ChatGPT Could Make These Jobs Obsolete – Is Your Job On This List?

nbc chimes feature scaled

The Surprising Story Behind The NBC Chimes

lg tv disable home screen scaled

How To Change The Default LG TV Home Screen To Live TV

Latest Posts

Intense woman listening to AM radio with headphones

7 Reasons To Save AM Radio In Cars

electromagnetism, frequency, radiation, Electromagnetic frequencies

5 Things Blocking The Efforts To Save AM Radio

There's no AM Radio In Tesla Cars

Why Electric Car Manufacturers Want To Kill AM Radio

MethodShop Animated Zoom Icon
  • About
  • Submit
  • Disclaimer
  • Privacy Policy
  • Contact
  • Subscribe
  • Store

Copyright © 2023 MethodShop · All Rights Reserved