While the original ARPABET codes developed in the 1970s by the Advanced Research Projects Agency supports 50 unique symbols to designate and differentiate between English phonemes, the CMU Pronouncing Dictionary's ARPABET convention (the set of transcription codes followed by 15.ai ) reduces the symbol set to 39 phonemes by combining allophonic phonetic realizations into a single standard (e.g. The application supports a simplified version of a set of English phonetic transcriptions known as ARPABET to correct mispronunciations or to account for heteronyms-words that are spelled the same but are pronounced differently (such as the word read, which can be pronounced as either / ˈ r ɛ d/ or / ˈ r iː d/ depending on its tense). Pronunciations of unfamiliar words are automatically deduced using phonological rules learned by the deep learning model. The lexicon used by 15.ai has been scraped from a variety of Internet sources, including Oxford Dictionaries, Wiktionary, the CMU Pronouncing Dictionary, 4chan, Reddit, and Twitter. Consequently, the entire lineup of characters in the application is powered by a single trained model, as opposed to multiple single-speaker models trained on different datasets. ġ5.ai uses a multi-speaker model-hundreds of voices are trained concurrently rather than sequentially, decreasing the required training time and enabling the model to learn and generalize shared emotional context, even for voices with no exposure to such emotional context. DeepMoji was trained on 1.2 billion emoji occurrences in Twitter data from 2013 to 2017, and has been found to outperform human subjects in correctly identifying sarcasm in Tweets and other online modes of communication. Įmotional contextualizers are representations of the emotional content of a sentence deduced via transfer learned emoji embeddings using DeepMoji, a deep neural network sentiment analysis algorithm developed by the MIT Media Lab in 2017. The application also supports manually altering the emotion of a generated line using emotional contextualizers (a term coined by this project), a sentence or phrase that conveys the emotion of the take that serves as a guide for the model during inference. The deep learning model used by the application is nondeterministic: each time that speech is generated from the same string of text, the intonation of the speech will be slightly different. Announcer (formerly), Carl Brutananadilewski from Aqua Teen Hunger Force, Steven Universe from Steven Universe, Dan from Dan Vs., and Sans from Undertale. Īvailable characters include GLaDOS and Wheatley from Portal, characters from Team Fortress 2, Twilight Sparkle and a number of main, secondary, and supporting characters from My Little Pony: Friendship Is Magic, SpongeBob from SpongeBob SquarePants, Daria Morgendorffer and Jane Lane from Daria, the Tenth Doctor from Doctor Who, HAL 9000 from 2001: A Space Odyssey, the Narrator from The Stanley Parable, the Wii U/3DS/ Switch Super Smash Bros. GLaDOS, known for her sinister robotic voice, is one of the available characters on 15.ai. In January 2022, it was discovered that Voiceverse NFT, a company that voice actor Troy Baker announced his partnership with, had plagiarized 15.ai's work as part of their platform. Several commercial alternatives have spawned with the rising popularity of 15.ai, leading to cases of misattribution and theft. Its gratis and non-commercial nature (with the only stipulation being that the project be properly credited when used ), ease of use, and substantial improvements to current text-to-speech implementations have been lauded by users however, some critics and voice actors have questioned the legality and ethicality of leaving such technology publicly available and readily accessible. Launched in early 2020, 15.ai began as a proof of concept of the democratization of voice acting and dubbing using technology. Developed by an anonymous MIT researcher under the eponymous pseudonym 15, the project uses a combination of audio synthesis algorithms, speech synthesis deep neural networks, and sentiment analysis models to generate and serve emotive character voices faster than real-time, even those with a very small amount of data. 15.ai is a non-commercial freeware artificial intelligence web application that generates natural emotive high-fidelity text-to-speech voices from an assortment of fictional characters from a variety of media sources.
0 kommentar(er)
