News · Google's 'Dear Upstairs Neighbors' shows the control surface, not the prompt box
Google's 'Dear Upstairs Neighbors' shows the control surface, not the prompt box
A Sundance short film built with fine-tuned Veo and Imagen models reveals what a real production interface for generative video looks like: visual input, localized editing, and iterative review.
The team said out loud that text prompting failed
Most generative-video demos lead with the prompt. This one leads with its rejection. The post states plainly that using text-to-video with a fine-tuned Veo model 'produced scenes that looked like Ada, but their movement was random, uncontrolled, and often bizarre.'
Text alone can’t convey the nuance and specificity needed for narrative animated filmmaking.Montana Labs
That is a notable admission from the company that ships the model. The animators needed to control 'the rhythm of Ada’s sleepy fingers typing, the comedic timing of her facial expressions, or the exact framing of a camera reveal' — and the interface for that turned out to be rough animation drawn in Maya and TV Paint, not a paragraph of description. The frontend for professional video generation is a canvas, not a chat box.
Video-to-video puts the artist's own tool at the front
The workflow the team calls 'show, don’t type' let animators work in their existing software and feed rough animation into fine-tuned models that restyle it. The examples are specific: Ben Knight's rough 3D in Maya restyled by Andy Coenen; Mattias Breitholtz's 2D in TV Paint transformed frame by frame by Forrester Cole through a custom ComfyUI workflow with fine-tuned Imagen; Steven Chao's low-poly effects converted into the expressionist look by Ellen Jiang and Connie He.
The recurring detail is that each artist stayed 'in their comfort zone, using their favorite animation tools.' The model becomes a transformation stage in an existing pipeline rather than the origin point. Crucially, the post describes 'an adjustable balance between tight control and creative improvisation' — meaning the interface exposes a control knob, not a fixed behavior. That adjustability is the actual product feature underneath the film.
Localized refinement and dailies replace one-click generation
The post is emphatic that 'none of our final shots were created in a single one-click generation.' Instead the team ran traditional 'dailies' reviews across multiple rounds of feedback, and built tools for localized refinement — editing specific regions of a video with an adjustable level of control. The concrete example is Erika Lu adding a rough mask to indicate where Ada's hair silhouette needed more volume, and Veo improvising an extra tuft that fit the shot.
That is region-based editing on video, which is the same interaction pattern that made inpainting usable in image tools. Applied to a temporal medium, it addresses the core failure of generative video in production: the inability to fix one thing without re-rolling everything. The workflow also let the team 'switch freely between Veo and traditional tools like Premiere,' meaning the model output remained an editable asset rather than a locked deliverable.
Fine-tuning taught deep structure, not just surface style
The team fine-tuned custom Veo and Imagen models 'from just a few example images' of Yingzong Xin's artwork. The result the post highlights is not color and texture matching but the model resolving a design contradiction: Ada's character follows strict 2D rules where her hair poof must stay in silhouette and never cover her face, a constraint a literal 3D sculpture can't satisfy from every angle. The fine-tuned Veo 'smoothly adapts the shapes to keep the silhouette correct as the head turns.'
This is the more interesting engineering claim, because it suggests the fine-tuning captured a rule about the design rather than an appearance. For teams evaluating custom-tuning workflows, it reframes the value: a small example set can encode intent that would be impractical to specify procedurally.
The one shippable piece: Veo 4K upscaling
Most of what this film demonstrates — the fine-tuning tooling, the video-to-video workflows, the masked local editing — is described as capabilities researchers 'had to develop' for the production, not products with a ship date. The single exception is Veo's 4K upscaling, which the post says is available in Flow and 'coming to Google AI Studio and Vertex AI later this month.'
So the practical implication for anyone building on Google's stack is narrow and specific: the immediate deliverable from this Sundance showcase is a finishing tool, not the control surface that made the film possible. The interaction patterns that actually solved the hard problems — visual-first input, adjustable control, region-level iteration inside a dailies loop — remain research prototypes. The film is a preview of the interface professional generative video will eventually need; the API you can call next month is the upscaler at the end of it.
Find this story relevant to you?
Contact us to find a unique solution
Χρειάζεστε συνεργάτη AI engineering που μπορεί να παραδώσει;
Βοηθάμε ομάδες στην Ελλάδα να ενσωματώσουν AI, να δημιουργήσουν AI-powered προϊόντα, να αυτοματοποιήσουν κρίσιμες ροές εργασίας και να εκσυγχρονίσουν τα συστήματα που τα στηρίζουν.
Σχετικά άρθρα
Περισσότερη ανάλυση για την παράδοση προϊόντων, τη λειτουργική ΤΝ και τη δουλειά στα συστήματα που κάνει την ανάπτυξη να αντέχει στην πράξη.