Google has introduced a new feature within its Gemini platform that allows users to transform hand-drawn sketches into functional applications. Announced on November 5, 2026, the feature leverages the Canvas tool, a workspace launched in March 2025, to generate and refine code directly from visual inputs such as app mock-ups, habit trackers, or game boards.
How the Sketch-to-App Workflow Operates
Users can upload a photograph of their sketch to the Canvas tool and prompt Gemini with the question, "Can you code this app?" Gemini then interprets the visual input and writes the corresponding code. The platform also provides a preview window where users can test the generated application and make real-time adjustments to elements such as colors, fonts, and features.
This workflow builds on Gemini’s existing capabilities, which include generating HTML/React web-app prototypes and Python scripts. The Canvas tool, enhanced with Gemini 2.5 models in May 2025, has previously demonstrated the ability to create working applications from natural-language descriptions. The sketch-based feature extends this functionality by using visual inputs as the basis for app development.
Technical Features and Considerations
For applications requiring persistent storage, Gemini automatically creates a Firestore database instance, though users can opt for alternative storage solutions. However, Google’s documentation highlights that Canvas apps are shared via public links, meaning that anyone with access to the link can view and edit shared data. This makes privacy review a critical step before sharing prototypes containing sensitive information.
Google has also documented a related sketch-to-code approach in its "Draw a Website" developer codelab. This process involves uploading hand-drawn wireframes and optional text instructions, which Gemini uses to generate website code through a Python Flask application deployed on Cloud Run.
Implications for App Development
The introduction of this feature significantly shortens the path from conceptual sketches to interactive, editable web prototypes. While the announcement does not provide specific benchmarks for accuracy or development time savings, the integration of sketch-based workflows into Gemini’s Canvas tool highlights the platform’s growing versatility in app development.
