Wan2.1

What is Wan2.1

Wan2.1 is an advanced Alibaba launchVideo Generationmodels that represent the role of AI technology inVideo CreationA major advancement in the field. With its self-developed high-efficiency codec architecture, the model realizes accurate simulation of complex physical scenes and delicate movements, and is capable of generating highly realistic video content. The model supports the generation of Chinese and English text effects to meet diversified creative needs, while its open source feature lowers the technical threshold and promotes the development ofAI Video GenerationPopularization and application of technology.

In addition, Wan2.1 has performed well in authoritative reviews, demonstrating strong technical strength. The release of this model not only enriches the means of video creation, but also brings brand-new creative inspiration and efficiency enhancement for film and television, advertising and other industries, marking that AI video generation technology has entered a brand-new stage of development.

Wan2.1 Technology Features and Breakthroughs

1. Highly efficient encoding and decoding capabilities::

   • Wan2.1 realizes efficient codecs for unlimited-length 1080P videos through its self-developed high-efficiency VAE (Variable Auto-Encoder) and DiT architectures. This technology is the first of its kind in the world and greatly improves the clarity and smoothness of video generation.

2. Chinese and English text effects generation::

   • Wan2.1 supports the generation of Chinese and English text effects, users only need to enter simple prompt words, such as "fireworks particles + ink calligraphy", you can generate high-quality video effects. This feature not only improves the visual effect of the video, but also brings great convenience to the advertising media and special effects industry.

3. Simulation of complex physical scenarios::

   • Wan2.1 is able to accurately simulate complex physical scenes, such as raindrops splashing water, ice skates cutting through ice slag, and so on. This highly reproducible physical effect makes the generated video almost the same as the real shooting effect, which provides a powerful support for movie and TV special effects production.

4. Complex motion generation and physical law following::

   • Wan2.1 is able to stably display complex body movements such as spinning, jumping, turning and tumbling of characters, and accurately restore complex physical scenes such as collision, rebound and cutting.

Wan2.1 open source and applications

Aliyun has announced the open source of four models from its Wan2.1 series of video generation macromodels as another important contribution by the company to the global open source community, opening them up for use by academics, researchers, and commercial organizations around the globe to further promote artificial intelligence (AI) technology innovation and universal access.

The open source is the four Wan2.1 models T2V-14B, T2V-1.3B, I2V-14B-720P and I2V-14B-480P with two parameter specifications of 14B and 1.3B, whose entire inference code and weights are all open source, and which support text-generated video and graph-generated video tasks respectively.

1. Open Source Protocols and Platforms::

   • Wan2.1 is based on the Apache 2.0 protocol open source, developers can download and experience its features for free on platforms such as Github, HuggingFace and MagicBuild Community.

2. Low hardware requirements::

   • Version 1.3B of Wan2.1 runs on common home video cards such as the NVIDIA 4090 and requires only 8.2GB of video memory to generate high quality video at 480p. This lowers the technical barriers and allows more developers and content creators to access and utilize this powerful video generation tool at a low cost.

3. market impact::

   • The open source of Wan2.1 accelerates the popularization of video generation technology and provides great convenience for secondary development and academic research. Its powerful generation capabilities and low hardware requirements give it a significant advantage in price and performance, creating a strong competition to the existing AI video generation market.

Wan2.1 Review and Approval

1. VBench reviews top the list::

   • In the authoritative evaluation of VBench, Wan2.1 has taken the top spot with a total score of 86.22% (one said 84.7%), which is significantly ahead of domestic and international models such as Sora, Luma and Pika. This achievement proves the excellent technical strength of Wan2.1 in the field of video generation.

2. Industry Recognition::

   • The technical strength of Wan2.1 has been widely recognized by the industry. Its open source not only provides developers with a rich library of materials, but also promotes diversity and technological innovation in the AI field.

Wan2.1 Use Cases and Cultural Understanding

1. Application Cases::

   • Wan2.1 has demonstrated its powerful generation capability in several application scenarios. For example, on the stage of the Spring Festival Gala, Wanphase created an immersive oil painting style choreography effect through image stylization and video generation technology, making the audience feel as if they were there.

2. cultural understanding::

   • Wan2.1 is not only technologically superior, but also deeply understands Chinese culture. It is capable of generating visual effects in line with traditional Chinese art, such as videos in the style of ink painting. This deep cultural understanding not only makes the video more appealing to the viewers' emotional needs, but also shows the unique charm of Chinese culture in the globalized perspective.

Project Address:
Github repository:https://github.com/Wan-Video/Wan2.1
Hugging Face:https://huggingface.co/Wan-AI
Magic Match Community:https://modelscope.cn/organization/Wan-AI