Highly rated for its high voice recognition accuracy and convenience through multi-device compatibility
Advanced Media Inc. (Headquarters: Toshima-ku, Tokyo; Chairman and CEO: Suzuki Kiyoyuki; hereinafter, Advanced Media) has used the AI voice dialogue avatar "AI Avatar AOI" system to turn "Shinshu Nakano," an official VTuber from Nakano City, Nagano Prefecture, into an AI. From late May, she will officially debut as a new content to promote the attractions of Nakano City, such as agricultural products and tourist information, at exhibitions and events.
"Shinshu Nakano" is an AI-based VTuber from Nakano City, Nagano Prefecture.
This time, we have the No. 1 domestic market share. ■ The AI voice dialogue avatar "AI Avatar AOI," which utilizes AmiVoice, an AI voice recognition service from Nakano City, was highly evaluated for its high voice recognition accuracy, its track record of adoption in local governments, and its reproducibility that does not impair the character's worldview, and was therefore selected to be used for the AI version of Nakano City's official VTuber "Shinshu Nakano." In addition, as the main purpose of use is exhibitions and events, the high convenience of being compatible with multiple devices, which can be used on a variety of devices, was also a deciding factor in its adoption.
AI that does not destroy the original worldview of the characters
By linking the unique dialogue system of "AI Avatar AOI" with "ChatGPT", we have achieved higher quality AI dialogue. Natural dialogue is possible while reproducing the original character settings of "Shinshu Nakano" as a VTuber, such as her personality, catchphrases, and expressions. In addition, we developed voice synthesis based on the recorded voice of "Shinshu Nakano" in order to faithfully reproduce the character's emotional expressions, motions, and animations. We have realized an AI that does not destroy the worldview of the original character.
In addition, the service utilizes a unique filtering function that avoids inappropriate terminology and unintended responses, as well as a dictionary registration function that converts technical terms and proper nouns into text with a high degree of accuracy, enabling conversations suited to a variety of uses.
AI-based "Shinshu Nakano" to be used for local government public relations activities such as various exhibitions
| The AI version of "Shinshu Nakano" made an advance appearance at the "SHINSHU NAKANO OUTDOOR FES 3" held on March 23rd (Sat) and 24th (Sun), which promoted the attractions of Nakano City and agricultural products produced in Nakano City, and freely conversed with visitors in natural conversational language. Visitors who conversed with "Shinshu Nakano" on a computer gave it high praise, saying, "I was impressed by the system that immediately taught me the attractions of Nakano City on the spot," and "It was fun to talk to Shinshu Nakano-chan." |  A look at "SHINSHU NAKANO OUTDOOR FES 2024" |
In addition, the AI version of "Shinshu Nakano" will make an appearance from the end of May during the "Rose Festival" (held from Saturday, May 5th to Sunday, June 25th) held in the spring and autumn at Ipponki Park Rose Garden. In the future, the AI version of "Shinshu Nakano" will be involved in PR activities to promote the charms of Nakano City at various events in the city.
We received the following comment from a Nakano City Hall official:
"Usually, VTubers mainly broadcast videos, so conversation is difficult, but with this introduction, we were able to have a realistic, real-time conversation with the AI-ized "Shinshu Nakano." By making conversation possible, which was previously difficult, I think the citizens who participated in the event gave it a high rating as an experience that made them feel closer to "Shinshu Nakano."
As the conversational AI market expands, Advanced Media will actively promote new initiatives with companies and local governments using "AI Avatar AOI."
About "Shinshu Nakano", an official VTuber from Nakano City, Nagano Prefecture
 | Name: Shinshu Nakano Gender/God Age: Same as the Encounter Stone Height: 161cm (Does this change depending on the number of households in Nakano City?) Weight: It's made of stone so it's heavier than it looks. As a virtual YouTuber promoting the charms of Nakano City, he will be sharing information about agricultural products and tourism in "Shinshu Nakano" |
・Shinshu Nakano Charm Communication Lab (YouTube):
https://www.youtube.com/channel/UCBcleDYvgSJ8xAe0r819wgA
・X (old Twitter):
https://twitter.com/nakanoshi_ureno?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5Eauthor
・Facebook: https://www.facebook.com/shinshu.nakano.ureno
・Instagram: https://www.instagram.com/nakanoshi_shinshu_nakano/
・Nagano Prefecture Nakano City Official Website:
https://www.city.nakano.nagano.jp/urenou/2021020200025/
About AI voice dialogue avatar “AI Avatar AOI”
1. ChatGPT and unique dialogue system recreates the characters' personalities
By linking our unique dialogue system with OpenAI's conversation generation AI "ChatGPT", we will achieve higher quality AI dialogue. We can respond in a flexible and versatile manner while recreating the personality, mannerisms, and phrasing of the original character. It is also possible to change the appearance of the avatar and customize the voice synthesis according to the user.
2. Multi-device compatible
You can choose from a variety of devices depending on your purpose and use, including VR/Metaverse, digital signage, and tablets. Furthermore, on the social VR app "VRChat", it is possible to have AI avatars express various emotions and provide guidance while moving around the world.
Five. Multilingual support (subtitle system)
In addition to Japanese, you can now speak in English, Chinese, and other languages. Voice recognition is performed in real time and characters respond to questions in multiple languages. The character's responses are displayed as subtitles in real time according to the set language, so the character's unique Japanese nuances, speaking style, and mannerisms are preserved, and the characteristics of the content are preserved using a system similar to movie subtitles. It supports multiple languages.
Four. Easily check and edit dialogue content with a simple management screen
You can check and edit the voice recognition results and automatic response contents from the management screen. Analyzing the data can also be used for marketing purposes.
5. AI automates customer support, allowing 24/365 support
Customer support can be handled unattended 24 hours a day, 365 days a year through AI voice dialogue. It contributes to reducing the number of man-hours required to respond to inquiries, resolving labor shortages in companies, and strengthening customer contact in a remote environment. Depending on the content of the conversation, it may be possible to arrange for a manned response.
■AI voice dialogue avatar “AI Avatar AOI” product page
https://www.advanced-media.co.jp/products/service/ai-avatar-aoi
*Source: ecarlate “Speech Recognition Market Trends 2024” Speech Recognition Software/Cloud Service Market
Above
Inquiries regarding this matter
Management Promotion Headquarters Public Relations Team
CTI Division
Inquiries about this product
