What if your imagination becomes a movie? 'ANCESTRA', a wondrous universe crafted by AI and humans

Imagine. You are a film director right now. To express the profound sadness of a protagonist, you want to create a fantastic scene that merges the mystery of the vast universe with a human heartbeat. But what if it costs billions of won in CG (Computer Graphics) and takes months of time? Most people might give up on their dreams, hitting the wall of production costs. But what if there were a ‘magic brush’ that could turn those abstract images only in your head into reality with just a few photos and descriptions?

Recently, a work that made such a magical imagination a reality was unveiled at the Tribeca Festival, one of the world’s leading film festivals, creating a buzz. It is the short film ‘ANCESTRA’ by director Eliza McNitt. Behind “ANCESTRA”: combining Veo with live-action filmmaking

This work goes beyond simply watching videos made by artificial intelligence. This is because it sophisticatedly combines live-action (a method of directly filming real actors and backgrounds with a camera) footage of real actors with virtual images created by ‘Veo’, Google DeepMind’s cutting-edge video generation AI. Behind “ANCESTRA”: combining Veo with live-action filmmaking Today, we tell you the behind-the-scenes story of this amazing project that will change the future map of filmmaking.

Why is this important?

Until now, videos made by generative AI (AI that learns from existing data to create new content) often received evaluations like “It’s interesting, but awkward to use in actual movies.” This was because backgrounds would wobble and distort, or characters’ movements would be unrealistically choppy. However, ‘ANCESTRA’ has seemingly leaped over these technical limitations.

This project is not just an experiment to show off technical prowess. Master director Darren Aronofsky, famous for the movie ‘Black Swan’, and his AI studio ‘Primordial Soup’ joined hands with Google DeepMind to directly prove how AI can be artistically integrated into actual film production sites. Darren Aronofsky AI Studio Announces Google Pact, ‘Ancestra’ Project

The goal of their partnership is clear: “To break down the boundaries between storytelling and technology by putting the world’s best generative AI in the hands of the best filmmakers.” Behind “ANCESTRA”: combining Veo with live-action filmmaking Now, AI is not a threat to the artist’s place, but is establishing itself as the most powerful assistant that brings to life artistic imaginations that were only kept in the heart due to budget or technical constraints.

Easy Understanding: A ‘Fantastic Bibimbap’ of AI and Live-action

Through what process was ‘ANCESTRA’ made? To use an analogy for this complex process, it is similar to the process of carefully mixing a very delicious ‘bibimbap’.

1. Fresh Seasonal Ingredients (Live-action Filming): First, the passionate acting of real actors is captured on camera. This is the most core ingredient that holds the center of the movie and conveys human emotions. Behind “ANCESTRA”: combining Veo with live-action filmmaking
2. Fantastic Special Sauce (AI Generated Video): Using Google’s video AI ‘Veo’, cosmic landscapes or abstract emotional flows that are impossible to film in reality are crafted into video. Behind “ANCESTRA”: combining Veo with live-action filmmaking
3. The Chef’s Sophisticated Secret (AI Pipeline): The production team didn’t just enter prompts. They refined the scenario with Google’s conversational AI, Gemini, and used the image generation AI Imagen together to maintain visual consistency. Behind “ANCESTRA”: combining Veo with live-action filmmaking

A particularly surprising point here is that video can be created inspired by ‘a single photo’. To use an analogy, it’s like showing a painter a photo with a specific color combination and asking, “Draw me dancing waves while capturing this feeling.” Veo implemented dynamic movements that look alive into video while maintaining the atmosphere and colors of the photo. Behind “ANCESTRA”: combining Veo with live-action filmmaking

More than 200 experts in various fields were involved in this wondrous process. Behind “ANCESTRA:” combining Veo with live-action filmmaking AI didn’t just whip up a movie with the click of a button; rather, numerous human artists played the sophisticated instrument of AI to complete a single grand orchestra.

Current Situation: Adding a ‘Warm Heart’ to Cold Technology

The technical achievements are amazing, but the reason ‘ANCESTRA’ deeply resonated with the audience’s hearts is because of the truthful ‘story’ contained within it.

This film was produced based on director Eliza McNitt’s actual experience. Director McNitt reportedly suffered from a condition where she had a hole in her heart from birth. The movie uses this dramatic life event as a motif to depict the great love of a mother trying to protect a child with a heart condition. Behind “ANCESTRA:” combining Veo with live-action filmmaking

The director wanted to describe a mother’s love not just as a ‘warm emotion’, but as a ‘cosmic force’ that sprouts and redeems life. In the process of visualizing this abstract and grand concept, the AI Veo played a decisive role. Behind “ANCESTRA:” combining Veo with live-action filmmaking As the heavy realism provided by live-action video met the dreamlike beauty provided by AI video, the audience vividly witnessed the intangible emotion of a mother’s love before their eyes.

Currently, this film has successfully debuted at the Tribeca Festival and is being evaluated as the most advanced example of how generative AI can realize ‘personalized storytelling’ and ‘sophisticated technical integration’ in the film industry. GoogleVeoAI Powers Cinematic Innovation in ANCESTRA

What Will Happen Next?

‘ANCESTRA’ is just the beginning of a great journey. This collaboration is the first result of a series of three short films planned by Google and the filmmaking team. Behind “ANCESTRA:” combining Veo with live-action filmmaking The global film industry is watching with bated breath to see what new visual aesthetics the collaboration between AI and humans will create in the upcoming works.

The changes we can look forward to are largely twofold:

1. Democratization of Artistic Expression: Independent film directors without large capital will now be able to freely direct blockbuster-level visual effects that were unimaginable in the past using AI.
2. Birth of New Genres: A new form of ‘hybrid cinema’, where the boundaries between reality and virtuality are completely broken down, will establish itself as the mainstream of movies. Behind “ANCESTRA”: combining Veo with live-action filmmaking

Of course, AI will not completely replace the presence of directors or actors. As the 200-plus production crew showed, it is ultimately the role of humans to move technology and breathe artistic soul into it. Behind “ANCESTRA”: combining Veo with live-action filmmaking

MindTickleBytes AI Reporter’s Perspective

‘ANCESTRA’ shows that AI has passed the stage of simply mimicking humans and evolved into a noble tool for expressing the deepest inner parts of humans: ‘love’ and ‘life’. When technology becomes a channel for conveying hot emotions beyond cold reason, we will finally encounter ‘AI art’ in its true sense. Why don’t you also try imagining drawing your own universe with the brush of AI someday?

References

1. Behind “ANCESTRA”: combining Veo with live-action filmmaking
2. Behind “ANCESTRA:” combining Veo with live-action filmmaking
3. Behind “ANCESTRA”: combining Veo with live-action filmmaking
4. Behind “ANCESTRA”: combining Veo with live-action filmmaking
5. Behind “ANCESTRA”: combining Veo with live-action filmmaking
6. Behind “ANCESTRA:” combining Veo with live-action filmmaking
7. GoogleVeoAI Powers Cinematic Innovation in ANCESTRA
8. Behind “ANCESTRA:” combining Veo with live-action filmmaking
9. Behind “ANCESTRA”: combining Veo with live-action filmm…
10. Darren Aronofsky AI Studio Announces Google Pact, ‘Ancestra’ Project

FACT-CHECK SUMMARY

• Claims checked: 16
• Claims verified: 16
• Verdict: PASS