Project GenieTranslation site

What is Project Genie?

Project Genie is a Google (launched by Google DeepMind and Google Labs) Experimental AI world modelprototype, is currently available to Google AI Ultra subscribers as a research prototype. It allows users to generate interactive virtual worlds with real-time exploration capabilities through natural language prompts and images.

Unlike traditional generative AI, Project Genie provides a Dynamically explorable 3D environment, allowing for roaming interactions in first-person/third-person perspectives.

Project Genie'sKey Features

1. World Sketching

• Users can create virtual scenes by describing them in natural language or uploading reference images.
• The system can combine text and image cues to generate a preliminary world model with spatial structure.
• Utilizing the Nano Banana Pro Render Preview allows the user to adjust details and perspective (first/third person, etc.) before entering the world.

2. World Exploration (WES)

• The user can move freely in the generated world.
• engine (loanword) Real-time generation of forward scenes, supports walking, flying, driving and more.
• The rendering of the environment is instantly rendered with user actions, eliminating the need to create a full world map in advance.

3. World Remixing

• Users can browse other people's work in the Creative Gallery and choose to remix it.
• A new version of the exploration scene is generated by modifying the original cue words.
• Supports random generation of new worlds or re-editing of generation logic.

4. Video export and sharing

• When you are done exploring, you can export the roaming process as a video file to save or share.

Project Genie'score technology

Project Genie incorporates a number of Google AI's latest technologies behind it:

1. Genie 3 World Model

• is the core generation engine responsible for transforming cue words and images into interactable scenes.
• Supports real-time reasoning and dynamic screen generation.

2. Nano Banana Pro

• Provides support for advanced visual previews that can preview world sketches before they are generated.
• Allows users to refine scene elements and layouts.

3. Gemini technology stack

• Provides basic language understanding with multimodal processing capabilities (text ↔ image ↔ scene).
• Responsible for high-level semantic reasoning and scene structure planning.

Currently, aspects including physical consistency and object behavior logic are still early explorations and will continue to be optimized.

Project Genie'sUsage Scenarios

1. Creative entertainment and game prototypes

• Rapid iteration of game design prototype scenarios.
• Players can create personalized worlds and explore them in real time.

2, film and animation production conceptualization

• The director/artist previews the scene layout and visual style.
• Reduce pre-production art production costs.

3. Architectural and spatial design

• Architects can immerse clients in design solutions before they are built.
• The space layout and lighting effects are more intuitive and palpable.

4. Education and training

• Teachers can create historical scenarios or scientific simulations such as ancient civilizations and virtual expeditions for research experiments.
• Students can learn in an immersive environment.

5. AI research and robot testing

• Generate diverse environments forsmart (phone, system, bomb etc)体训练与验证。
• It can reduce the cost of building real scenarios.

How do I use Project Genie?

1. Registration and access

• Visit the official Project Genie address (e.g. labs.google/projectgenie).
• Currently need to have Google AI Ultra Subscription Access(U.S. regions open first).

2. World creation

• Enter a natural language prompt (e.g., “future city night scene”) or upload a reference image.
• Use Nano Banana Pro to generate sketch previews.
• Adjust tips and parameters as needed.

3. Choice of perspective

• Select First Person or Third Person on the preview screen.
• OK to enter 3D Explore mode.

4. Exploration and control

• Use keyboard/mouse/joystick for movement and perspective adjustment.
• The direction of the lens can be modified at any time during exploration.

5. Remix and preservation

• Explore and remix the world in the gallery or create a new version yourself.
• Export exploration videos or share generated content.