SignsTranslation site

What are Signs?

Signs is an AI platform focused on the learning and application of American Sign Language (ASL), launched by NVIDIA in conjunction with the American Society for Deaf Children (ASDC) and digital agency Hello Monday. The platform aims to help more people learn and apply American Sign Language efficiently through advanced AI technology and user-contributed video data to improve the accuracy, scalability, and comprehension of natural sign language styles for sign language recognition.

Signs Key Features

1. Real-time AI feedback: Users can express themselves in sign language through the camera, and the system then analyzes the gestures and provides instant corrections. This feature makes the learning process more intuitive and efficient.
2. 3D avatar demo: The platform is equipped with a 3D avatar that demonstrates correct ASL gestures, making it easy for users to learn by visual comparison and further enhancing learning efficiency.
3. User Contribution and Optimization: User-submitted videos of real ASL gestures are used as material for training AI models, and the platform's recognition capabilities will continue to grow as user data accumulates.
4. Open source data sets: The platform's dataset already contains 400,000 video clips covering 1,000 sign language words, with plans to open it up to a wider audience in the future in order to expand the size of the dataset and support research on accessibility applications.

Signs Usage Scenarios

1. Deaf Community Learning: The Signs platform provides the deaf community with a new learning tool to help them master American Sign Language more efficiently.
2. Learning for people with normal hearing: For the hearing population, the Signs platform provides an opportunity to understand and learn sign language, which helps to promote understanding and respect for the deaf community.
3. Barrier-free communication: The application of the Signs platform helps to break down the communication barriers between deaf and hearing people and promotes barrier-free communication in society.

Signs Operating Instructions

1. Register & Login: Users first need to register and log in to their account on the Signs platform.
2. Turn on the camera.: When using the real-time AI feedback feature, users need to turn on the camera in order for the platform to recognize and analyze gestures.
3. Perform sign language expressions: Users can express themselves in sign language through the camera, and the system then recognizes the gestures and provides instant corrections.
4. Watch a 3D avatar demo: Users can watch 3D avatars demonstrate correct ASL gestures for comparative learning.
5. Upload video contribution data: Users can also upload their own sign language videos to contribute data to the platform's AI model training.

Why Signs

1. technological innovation: The Signs platform employs advanced AI technology that accurately recognizes and corrects users' sign language expressions, while providing 3D avatar demonstrations that greatly enhance learning.
2. social responsibility: NVIDIA's launch of the Signs platform not only demonstrates its ability to innovate technology, but also its commitment to social responsibility. The platform helps break down communication barriers between deaf and hearing people and promotes the development of accessible technology.
3. User Contribution and Optimization: The Signs platform continuously learns and optimizes AI models through user-contributed video data, enabling the platform's recognition capabilities to grow with the accumulation of user data.
4. Wide range of applications: The Signs platform can be used in a wide range of scenarios, not only for learning in the deaf community, but also for learning in the normal hearing population and for accessible communication, with a wide range of applications.