Site icon The GDELT Project

Visually Geocoding A TV News Broadcast Using Gemini: From Images To Geographic Coordinates + Gemini As Investigative OSINT Journalist

Last week we demonstrated how Gemini 3.8 Flash's visual reasoning is sufficiently advanced that it can visually describe an entire television news broadcast from a 1/4fps thumbnail grid with sufficient detail that it can be used with keyword search for advanced visual search of a broadcast. In that example we extracted one frame every 4 seconds from a television news broadcast, reduced them to thumbnail size and combined them into a thumbnail grid 6 across and with as many rows as needed to represent the entire broadcast. Here we repeat this process, but this time we ask Gemini 3.8 Flash to search for identifiable geographic locations and compile them into a list, performing "visual geocoding". While not perfect, the results below are deeply impressive, showing Gemini able to visually understand the input image as a montage of independent very low resolution thumbnail images and identify a number of locations, suggesting that with higher resolution and finer-grained images, it could likely precisely geocode a video in the same way as an investigative journalist. No data was used to train or tune any model and Gemini was provided only the two low-resolution thumbnail grids below and did not have any access to the broadcast itself.

You are an expert visual geospatial analyst.
Attached is a thumbnail grid of a video.
Go through it extremely carefully and identify any locations you can identify (specific landmarks, buildings, mountains, landscapes, waterways, cities, etc). Be exhaustive. Give me a bulleted list of each location you identify and the specific rows in the thumbnail grid in which it appears.
Explain why you believe that location is depicted.

Let's start with this broadcast from Yemen earlier today (click to see the full res version):

Here are the locations Gemini visually identified from the thumbnail grid:

How about this broadcast from Afghanistan earlier today (click for full res)?

Gemini's geographic assessment:

Exit mobile version