Making a short AI film with tools from Google, Runway, ElevenLabs, and Midjourney shows the tech has improved but it takes tedious work to get scene consistency
We tried to direct an AI film with Veo and Runway. The tools are magic. The process is madness. — Click for Sound
veo3 is far too pricey to use just for personal fun all the time, so the primary high-volume use case will be for bulk youtube shorts monetiziation. this is the first time (i think?) an sota genai model provider also owns the resulting distribution of much of what users will make
AI slop. We set out to make an AI film that was more than that—one with humor, characters and meaning. Every frame in this was generated with Google Veo and Runway. Presenting My Robot And Me: [video]
Watch My Robot and Me, a short film I made with @joannastern. Every single frame was created with AI. Take a look and then read below for how we made it. [video]
I can see why many hate AI video. As a video journalist and producer who loves nothing more than being out in the field, I thought I would hate it too. But there's a new kind of creativity here—one that surprised me. Read our @WSJ piece for more: https://www.wsj.com/... [image]
After testing tons of tools, we landed on Runway and Veo. Sora didn't come close. Still, for every good shot we got, we also got at least a few terrible ones. Roll the bloopers: [video]
I then generated the video mostly in Veo 2 and 3, + a bit of Runway Gen 4. Most of my Veo prompts were in the 180 word range. I used a Gemini 2.5 thread with instructions and best practices from folks like @henrydaubrez + my experience to create prompts https://x.com/...