Google DeepMind has unveiled 'Backstory,' a tool that uses Gemini AI to uncover the hidden context and origins of online images.
Finding the ‘Real Story’ Behind a Single Photo
Imagine. You’re scrolling through social media this morning and find a truly amazing photo. It’s a picture of a giant unicorn appearing in the middle of a peaceful city. It looks so vivid it seems real, but on the other hand, you have doubts: “Could this really be true?” Or perhaps you later hear that a shocking photo of an accident scene you saw in the news actually happened in another country years ago.
We are now living in a “flood of digital content.” Source 2 It is an era where anyone can easily edit photos and even create images that don’t exist. In such a world, it’s becoming increasingly difficult to trust the images we see at face value. To use an analogy, it’s like finding your way through a thick fog. It’s a situation where it’s hard to distinguish between real information and cleverly manipulated traps.
To solve this problem, Google DeepMind has come up with an interesting solution. It is Backstory, an AI detective that tells you the origin and history—the “backstory”—of an image. Source 1, Source 7
Why is This Important? “Rebuilding Broken Trust”
In the online world we face every day, images are the most powerful means of conveying information. As the saying goes, “A picture is worth a thousand words,” the impact and persuasiveness of a single photo are greater than a long text. However, they are just as easy to distort. When a single photo circulates without context (the circumstances or background), people can easily misunderstand, and sometimes it escalates into social conflict or unnecessary fear.
Backstory has two main goals:
- Combating Misinformation: It prevents incorrect information from spreading at the speed of light. In particular, it is a great help in preventing cases where AI-generated images are disguised as actual news photos. Source 10, Source 12
- Improving Digital Literacy: Simply put, it improves the ability to critically understand and utilize digital information. Beyond users simply consuming information, it helps them develop the power to look at and understand images critically for themselves. Source 10, Source 12
Ultimately, this tool helps us regain “trust” in the visual information we see online. Source 2 It goes beyond simply concluding “this photo is fake” and provides a solid basis for us to judge for ourselves by showing where this photo came from and what process it went through to appear before our eyes.
Easy to Understand: A Detective Checking a Photo’s ‘Passport’
How should we understand Backstory? To help you understand, let’s explain it with two analogies.
1. An ‘Official Nutrition Label’ for Photos
It’s similar to checking the nutrition facts label on the back of a processed food product when we buy it. Just as we look at the ingredients, expiration date, and whether there are any harmful ingredients, Backstory provides a kind of “digital nutrition label” for images. It transparently shows when this photo first appeared in the world (release date) and what process it went through to be edited (processing method). Source 10
2. The ‘CSI: Digital Forensics’ of the Online World
Backstory is powered by Google’s cutting-edge AI, Gemini. Source 2 Gemini finds small clues in photos one by one, like a seasoned investigator.
Specifically, Backstory analyzes the following with microscopic precision:
- Metadata: This is “data about data” hidden inside a photo file. it includes the shooting location, time, camera settings, etc. Backstory carefully examines this information and compares it with the actual identity of the photo. Source 10
- Image Modifications: It evaluates whether there are any changes from the original, such as whether the photo was cropped or if certain parts were erased or painted over with AI. Source 10
By analogy, if existing “reverse image search” was at the level of simply finding people who look alike, Backstory is like thoroughly checking that person’s academic record and passport records. When you show a photo to a friend, it provides in-depth information just as if that friend explained in detail, “Oh, this photo was taken in Switzerland last May, and originally there was one more person in the bottom right, but it was erased.” Source 2, Source 7
Current Status: A Future Technology Still ‘In Experimentation’
You can’t use Backstory perfectly on every website or browser right now. Google DeepMind is currently operating this tool as an experimental tool. Source 1, Source 4, Source 6 In other words, it is in the process of being refined to provide information more accurately and safely.
However, the significance of this experiment is very large. As technology advances, it will become easier to create more sophisticated “fakes,” but this is strong evidence that the technology to find the “truth” is also advancing. Source 7 Backstory will soon become a reliable assistant helping us analyze online images more easily and accurately. Source 3
What Happens Next? The Preparation We Need
In the future, even if we see a single photo, the era may come when saying “Did you ask Backstory?” becomes the basis for fact-checking news. Source 10 AI will do complex analysis and find sources for us, but ultimately, the final judgment is up to us humans.
When faced with a provocative photo or an amazing image, instead of unconditionally believing or sharing it, develop the habit of thinking once more, “What is the backstory of this photo?” That is the biggest message Backstory wants to convey to us through technology, and the attitude we should prepare. Source 12
AI’s Take
The battle of “spear and shield,” catching fakes made with technology using technology, has begun in earnest. However, I hope that Backstory will not just stop at being a “shield” that blocks attacks, but will become “bright glasses” for all of us that allow us to see the complex digital world more clearly. Truth is not simply proven by technology, but is completed by our will to see the truth using technology.
References
- Exploring the context of online images with Backstory
- Exploring the context of online images with Backstory
- Exploring the context of online images with Backstory
- Exploring the context of online images with Backstory
- Exploring the context of online images with Backstory
- How Google DeepMind’s Backstory Brings Context to Online Images
- Google DeepMind’s Backstory: Elevating Image Trust Online
-
[Exploring the context of online images with Backstory Backstory…](https://nowletus.com/news/exploring-the-context-of-online-images-with-backstory-now1241.html)
- Gemini Photo
- Backstory
- Image Tracker
- Gemini
- AlphaGo
- GPT-4
- Metadata
- Image modification history
- Photographer's MBTI