Youdao Digital Person

Good government prevails.digital personAlgorithm is a deep synthesis service algorithm launched by NetEase Yodao Information Technology (Beijing) Co., Ltd. which is based on deep learning and integrates speech recognition technology (including ASR, TTS, etc.) and computer vision technology (including face detection, face generation, video synthesis, etc.). It can replace the mouth shape in the original video according to the audio file (real person or TTS voice) or text provided by the user, combined with any piece of face video, to generate a realistic mouth synchronized speaker video.

Functional Features

1. Multi-functional support：有道digital person支持多种功能，包括但不限于照片说话和唱歌、视频翻译、形象克隆、歌声合成以及大屏交互等。
2. Precise synchronization of sound and lips: With precise synchronization of voice and lips and realistic expressions, Yau Tao Digital Man is able to achieve high-precision mouth matching and natural expressions through customized training with about thirty minutes of sampling data.
3. Efficient customization: Users can easily create their own avatars through the Small Sampling Digital People platform, which combines intelligence and personalization. A 1-minute video can be uploaded to train an image doppelganger in 30 minutes, with low image customization costs and good lip-sync matching.
4. Multilingual drive: The Yodo Digital Person algorithm has a multilingual-driven capability to support a wide range of scenario applications related to speaker generation.
5. real time interaction: Youdao Interactive Digital Man supports real-time voice interaction with low first-frame latency, supports real-time voice interruption, has a flexible brain, and can access document Q&A to build a proprietary knowledge base for the enterprise.

application scenario

1. Media field: The Yodo Digital Person algorithm is widely used for content creation in the media field, helping users to customize their digital person avatars, replicate their exclusive voices, and generate video content consistently and quickly.
2. Education：有道数字人在教育领域也有广泛应用，如口语教学、知识科普等。有道推出了搭载其教育大模型“子曰”的AI数字人应用，具备real time interaction、语法纠错、评分和话题切换等功能，能够实现正常的交流。此外，有道还推出了全球首个虚拟人口语教练Hi Echo，进一步拓展了其在教育领域的应用。
3. Enterprise Customer Service：有道数字人可以作为企业的数字客服，提供24小时不间断的client service，提高客户满意度。
4. cultural and tourism media: Youdao digital people are suitable for the cultural and tourism media field, and can be used as virtual tour guides or virtual hosts to provide personalized travel experiences or program hosting.

Technical Advantages

1. Fully in-house developed technology: Youdao Digital Person uses fully self-developed AI technologies such as speech recognition, speech synthesis, multimodal perception, document QA, etc., to ensure the advancement and stability of the technology.
2. offline deployment: Youdao digital person all offline deployment in the interactive all-in-one machine, to protect the document privacy and security, smooth interaction with low latency. At the same time, the model is small and can be deployed offline, greatly reducing the cost of large-screen interaction brought about by servers, broadband traffic, and rendering arithmetic.
3. deep learning: YouDao Digital Person applies neural network model, self-developed inference strategy and face-fitting logic to reduce jitter and other distortions, and the effect is real and stable.

With its advanced technological background, rich functional features, wide range of application scenarios and significant technological advantages, Arigato Digital Person provides an efficient and natural interactive experience in a number of fields.