The Real Time Voice Cloning Toolbox

What Is Real Time Voice Cloning?
Real Time Voice Cloning is involves a deep learning framework that can generate computerized voices by listening to audio recordings. The framework creates numerical representations of the voices it listens to, which can then be used by a text-to-speech program to create a copy of those voices to read text aloud.

The Real Time Voice Cloning Toolbox is written in Pyton, and is an implementation of Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis or SV2TTS, which does the voice analysis. It is used alongside WaveRNN, Tacotron 2, and Generalized End-To-End Loss For Speaker Verification (GE2E) for voice synthesizing and encoding.

This project interests me because of its numerous potential uses. It could be used to give those who lose the ability to speak their voices back, as well as to create computerized voices that sound more natural. However, it also opens up the possibility of people voices being used without their consent, and I am curious as to how these issues are addressed, if at all.

Comments

Post a Comment

Popular posts from this blog

External Pull Request and Creating a Spam Checker for Telescope

Image
This week I was working on two projects: fixing an error with Pokemon Showdown's downloaded match replays, and creating a spam checker for Telescope Pokemon Showdown Client The Issue   Resume button appears under Play button on launch The external issue I worked on was preventing the Resume button from appearing behind the Play button when viewing a downloaded replay from Pokemon Showdown: something I thought would be more complex than it ended up being, having worked with Pokemon Showdown before. The Fix After finding the class I had to work on, replay-embed.js,  I had to figure out how downloaded replays worked with replay-embed. While waiting for a response from Zarel, I tried generating a replay using my cloned version for Pokemon Showdown Client to no avail. Eventually, I learned from Zarel that the replay file has to be edited so that the script source points to my version of replay-embed. I changed the path to the filepath to my copy of replay-embed, but the bat
Read more

Second Contribution of Hacktoberfest

Image
For the second week of Hacktoberfest, I contributed to Fast Read , a React App created by Hamzaolak. The Fast Read Application The Issue   As I was having issues with the other projects I was planning to work on, I settled on another simple fix; changing the names of the custom colors defined in the code. The Fix After finding the color definitions, all I had to do was change the names in the definitions, as well as in the files that use those colors. The color names being in the issue description was helpful, especially with them being in the same order as the original colors. Creating the Pull Request After confirming that everything works as intended, I switched the origin remote to my forked version of the repo. Then I created a new branch and pushed my commit to it. Finally, I created a pull request to merge my code into the original project. Issues and Lessons Learned While searching for projects to contribute to for this week, I noticed many
Read more

Adding 'Favorite' System to Pokemon Showdown: External Pull Request and Final Week of OSD600

Image
Despite saying I wanted to work on a new repo for my final external pull request, after not being able to find a suitable issue, I ended up contributing to the Pokemon Showdown Client again. This time, I added an even larger feature than my last one: a 'favoriting' system that lets users quickly access users they play with frequently. The Issue Currently, the only way to match up with specific users on Pokemon Showdown is to either search them by username, or to find them in the chatrooms. However, the username search system requires an exact username, and turns up a result even if no user exists under that name. You'd only find out the account doesn't exist once you try to send a message or start a match. Opened chat even though user doesn't exist The Fix The solution I decided on was to allow users to 'Favorite' other users, allowing them to be quickly found later. Toggling favorite/unfavorite The first thing I did was add the '
Read more