Simulate real-world places with Project Genie and Street View

2026-05-19 · Source: The Keyword · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems, Gaming & Interactive Media · Depth: Intermediate, medium

Summary

Google DeepMind's Project Genie, a general-purpose world model for generating diverse, interactive environments, is expanding its capabilities by integrating with Google Street View imagery. Announced on May 19, 2026, this new feature allows users to create virtual worlds anchored in real-world locations. Project Genie, previously used for training AI agents and simulating hyper-realistic road environments for Waymo, now enables users to select a U.S. location, apply a creative style like "Ocean World" or "B&W film," and describe a character to generate imaginative scenes based on Street View data. This experimental prototype is rolling out globally to eligible Google AI Ultra subscribers (18+) for \$200, offering a tool for research, agent navigation, and creative exploration. The Street View grounding capability is currently available for U.S. places, with future expansion planned.

Key takeaway

For AI Product Managers or developers building virtual environments, Project Genie's new Street View integration offers a powerful tool to ground simulations in reality. You can now create diverse, interactive worlds based on real U.S. locations, applying creative styles for agent training or immersive experiences. Consider exploring this experimental prototype to enhance the realism and complexity of your AI agent testing or virtual content creation.

Key insights

Project Genie now integrates Google Street View to create interactive, reality-anchored virtual environments for AI and creative exploration.

Principles

• Grounding AI models in reality enhances utility.
• Real-world imagery can diversify virtual environments.
• Experimental prototypes drive future AI applications.

Method

Select a U.S. location via Maps pin, choose a style (e.g., "Desert Sands"), describe a character, and Genie generates an imaginative world tied to Street View imagery.

In practice

• Simulate AI agent navigation in complex real-world settings.
• Recreate historical scenes from Street View data.
• Explore real places with imaginative stylistic overlays.

Topics

• Project Genie
• Google Street View
• Virtual Environments
• AI Agents
• Simulation
• Google AI Ultra

Best for: Computer Vision Engineer, Research Scientist, AI Scientist, Robotics Engineer, AI Product Manager

Related on AIssential

• Simulate real-world places with Project Genie and Street View — Project Genie now integrates Street View to create imaginative, interactive virtual worlds grounded in real-world locations.
• Google’s Genie world model can now simulate real streets with Street View — Google DeepMind integrates Street View with Project Genie to create interactive, real-world-anchored simulations for diverse applications.
• 🤖AI Agents Weekly: Project Genie, Kimi K2.5, Interactive Tools in Claude, Qwen3-Max-Thinking, Mistral Vibe 2.0, Agentic Vision — AI world models and multimodal agents are advancing real-time simulation, agent coordination, and visual coding capabilities.
• Google pairs its Genie world model with Street View to create explorable AI worlds based on real places — Google's Genie model uses Street View data to create interactive AI worlds for agent training and simulation.
• The Sequence Knowledge #838: Project GENIE: Building Playable Worlds from Pixels — Project GENIE enables AI to simulate and interact within playable pixel-based worlds, fostering agency beyond text-based models.
• Open Thread 421 — Genie 3 creates persistent, explorable AI-generated worlds by leveraging extensive spatial data and advanced world memory.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by The Keyword.