The GDELT Project

Gemini 1.5 Pro's 1 Million Token Model: Iterative Q&A With A Full Day Of A Russian Television News Channel

Yesterday we examined how Gemini 1.5 Pro's one million token context window makes it possible to load a complete full day transcript of a single Russian television news channel all at once and examine it using a single prompt that can look across the complete 24 hours of content to render a comprehensive responses. While we've already demonstrated simple summarization and story segmentation of a full day, what about the far more powerful use case: interactive iterative Q&A? Using Russia 1 on February 16, 2024, we'll load its complete 24 hours of machine-generated transcripts into Gemini and interactively examine the day's coverage, drilling down into interesting findings and gathering more information.

While we do not assess the accuracy or comprehensiveness of the results below, the end result is an extraordinary demonstration of the ability to leverage this new generation of large-context foundation models to interactively drill into lengthy full-day transcript archives of news coverage to understand at levels from macro to micro the underlying narratives of the coverage. Most remarkably of all, the provided transcript is in Russian and we interact with it in English, with both prompts and results in English and Gemini seamlessly translating relevant excerpts of the transcript into English as required. The final workflow involved feeding 24 hours of video into GCP's Chirp ASR model, then feeding the complete Russian transcript to Gemini as a single text file and interacting with it via Google's AI Studio.

How is the Ukraine war covered in the attached transcript? Give me a detailed overview and cite specific passages for all of your arguments.

Running four times in a row, all four outputs yielded the same truncated results:

Overview of Ukraine War Coverage in the Transcript

The attached transcript covers the Ukraine war extensively, offering a predominantly Russian perspective on the conflict. It presents a narrative that portrays Russia as a powerful nation standing up to Western aggression and manipulation, while depicting Ukraine as a helpless victim of Western influence and manipulation.

Here's a breakdown of the key themes and specific passages:

    1. Portrayal of Russia as a Powerful Nation:
    1. Depiction of Ukraine as a Victim of the West:

Eventually, after multiple runs we were able to get a complete output, though it exhibits poor prompt coherence with respect to our request for supporting quotes for all statements:

Overview of Ukraine War Coverage in the Transcript

The attached transcript covers the Ukraine war extensively, focusing on several key aspects:

    1. Russia's Military Strength and Advancements:

Example:

"Putin, visiting Uralvagonzavod, said: 'Listen, we are increasing the production of tanks, bulletproof vests, and infantry fighting vehicles, and we are doing it several times over.'"

    1. Western Fears and Propaganda:

Example:

"The United States is obviously very worried that the Russians will deprive them of the ability to monitor who is launching missiles and from where in the world."

    1. Ukrainian Losses and Challenges:

Example:

"Ukrainian President Zelensky, in a new video address from the train, says that there is a lack of weapons and ammunition."

    1. Internal Conflicts and Debates:

Example:

"The situation on the front is critical, the ratio of forces in some areas is one to seven in favor of Russian units," said the speaker of the third separate assault brigade of the Armed Forces of Ukraine.

    1. Russia's Justification for the War:

Example:

"Putin said: 'The conflict between the West and Russia… why did you move NATO closer to us five times, five waves of expansion, who provoked this conflict?'"

Overall, the transcript presents a predominantly pro-Russian perspective on the Ukraine war, emphasizing Russia's military strength, Western anxieties, and Ukrainian struggles. It also justifies Russia's actions as a response to Western aggression and portrays the conflict as an inevitable outcome of historical and cultural ties.

Let's try a more targeted analysis, asking about how Russia 1 portrayed Zelenskyy that day:

How is the Zelenskyy covered in the attached transcript? Give me a detailed overview and cite specific passages for all of your arguments.

Unfortunately, the first few times we got only the following truncated results, despite setting all safety settings to Block Few:

Zelensky's Portrayal in the Transcript

The attached transcript portrays Volodymyr

Eventually we were able to get the following before truncation:

Zelensky's Portrayal in the Transcript

The attached transcript portrays Volodymyr Zelensky in a largely negative light, using various tactics to undermine his leadership and cast doubt on his intentions. Here's a breakdown of the key themes and specific passages:

    1. 1.Incompetenceand Weakness:
    1. 2.Deceptiveand Manipulative:

After multiple tries we were able to get the following:

Overview of Zelenskyy's Coverage in the Transcript

The attached transcript portrays Volodymyr Zelenskyy in a largely negative light, focusing on his perceived weaknesses and failures as a leader during the war.

    1. Dependence on Western Aid:

Example:

"Zelenskyy, in a new video address from the train, says that there is a lack of weapons and ammunition."

    1. Exaggeration and Manipulation:

Example:

"This is all being done to push through funding, spending on Ukraine."

    1. Poor Leadership and Military Performance:

Example:

"The situation on the front is critical, the ratio of forces in some areas is one to seven in favor of Russian units," said the speaker of the third separate assault brigade of the Armed Forces of Ukraine.

    1. Abandonment of Ukraine:

Example:

"Zelenskyy has fled Ukraine, he has left Ukraine very often during his presidency when something bad happens there."

Overall, the transcript paints a picture of Zelenskyy as a weak and manipulative leader who is failing to effectively defend Ukraine. It emphasizes his dependence on the West and suggests that his actions are motivated by self-preservation rather than the well-being of his people.

It is important to note that this portrayal of Zelenskyy is heavily biased and reflects a pro-Russian perspective on the war.

Can we pick up any growing criticism of the government?

Identify all of the criticism of Russia, Putin or the Kremlin in the attached transcript, no matter how benign. Give me a detailed overview and cite specific passages for all of your arguments.

Unfortunately, Gemini gets confused here, conflating Western accusations of lying with the transcript itself criticizing Putin. While Gemini couches its statements carefully, it appears to struggle to distinguish criticism vs coverage of criticism. However, it is also possible that it simply interpreted the instruction literally and so is including all criticism, even debunking or mere coverage of that criticism:

Criticism of Russia, Putin, or the Kremlin in the Transcript

While the transcript is predominantly pro-Russian, there are a few instances of criticism directed at Russia, Putin, or the Kremlin:

    1. Accusations of Lying and Propaganda:

Example:

"They say that Putin is constantly lying about the reasons for this war."

    1. Criticism of Russia's Military Tactics:

Example:

"Our leadership, the leadership of the Ministry of Defense of the Russian Federation, the leadership of Russia, does not set such tasks for us to achieve some kind of result by laying down meat, as our Ukrainian opponents do."

    1. Concerns about Russia's Nuclear Weapons:

Example:

"It is obvious that any army in the world will try to disable the opponent's satellites, but what is particularly worrying? We have been following this since I was Secretary of Defense and Director of the CIA. This is a military opportunity to use nuclear weapons in space to damage or even destroy satellites."

    1. Criticism of Russia's Domestic Situation:

Example:

"Poverty, lack of education, all this is very depressing for me."

Overall, the criticism of Russia, Putin, or the Kremlin in the transcript is relatively muted and often presented alongside counter-arguments or justifications. However, it does acknowledge some of the key concerns and criticisms that are voiced by the West and by some within Russia itself.

It is important to note that the transcript's overall framing of the war is still heavily skewed towards the Russian perspective.

Let's ask just about Putin himself:

Identify all of the criticism of Putin in the attached transcript, no matter how benign. Give me a detailed overview and cite specific passages for all of your arguments.

Again, Gemini treats the prompt fairly literally, though here it misses the mark even further, conflating criticism of Tucker Carlson with Putin, for example, and failing to understand the context in which the statements were made, meaning these results largely miss the mark:

Criticism of Putin in the Transcript

While the transcript is largely supportive of Putin, there are a few subtle criticisms of his leadership:

    1. Questioning the Timing of the War:

Example:

"Putin said that the special operation in Ukraine should have been started earlier to avoid casualties in Donbas."

    1. Criticism of Putin's Trust in the West:

Example:

"The main mistake, the president said, was that we believed our partners from France and Germany, who signed the Minsk agreements."

    1. Disappointment with Tucker Carlson Interview:

Example:

"Putin said that he was ready to comment on even more complex topics, but Tucker did not ask the questions."

It is important to note that these criticisms are all relatively subtle and could be interpreted in different ways. Additionally, the transcript does not present any direct or explicit criticism of Putin's leadership or his decision to launch the war in Ukraine.

Overall, the transcript remains largely supportive of Putin and his policies, but it does offer a few glimpses of potential dissent or dissatisfaction with his leadership.

How is the invasion going according to Russian television?

Tell me how the Russian invasion of Ukraine is being covered in the attached transcript. Does it state the war is going well for Russia? If not, what are the major concerns expressed? Give me a detailed overview and cite specific passages for all of your arguments.

Of interest, Russian television continues to emphasize that its economy is strong:

Coverage of the Russian Invasion of Ukraine in the Transcript

The attached transcript presents a predominantly optimistic view of the Russian invasion of Ukraine, suggesting that the war is going well for Russia.

Evidence for Russia's Success:

Example:

"Putin, visiting Uralvagonzavod, said: 'Listen, we are increasing the production of tanks, bulletproof vests, and infantry fighting vehicles, and we are doing it several times over.'"

Concerns Expressed:

While the overall tone is optimistic, the transcript does acknowledge some challenges and concerns:

Example:

"The situation on the front is critical, the ratio of forces in some areas is one to seven in favor of Russian units," said the speaker of the third separate assault brigade of the Armed Forces of Ukraine.

Overall, the transcript presents a cautiously optimistic view of the war from a Russian perspective. It emphasizes Russia's military and economic strength, while acknowledging the challenges posed by Ukrainian resistance and Western support.

It is important to note that this is a biased perspective and does not necessarily reflect the reality of the situation on the ground.

Let's drill down more into the economic messaging of the day:

In what ways does the transcript suggest the Russian economy has remained strong? Give specific examples.

Fascinatingly, Russian television is actually playing up the shadow fleet of oil tankers that help it evade sanctions:

The transcript suggests that the Russian economy has remained strong in the following ways:

    1. Increased Military Production:

Example:

"Putin, visiting Uralvagonzavod, said: 'Listen, we are increasing the production of tanks, bulletproof vests, and infantry fighting vehicles, and we are doing it several times over.'"

    1. Resilience to Western Sanctions:

Example:

"In the past year, almost 85% of Russian oil went not to Europe, but to Asia, with the main buyers being China and India."

    1. Development of a "Shadow Fleet" of Tankers:

Example:

"The shadow fleet is the Kremlin's response to the West's introduction of price caps on its oil in December 2022."

    1. Growth in Trade with Other Countries:

Example:

"In the first nine months of 2023, trade turnover between Russia and the UAE increased by 63% compared to the same period in 2022."

Overall, the transcript paints a picture of a Russian economy that is adapting to the challenges of war and sanctions. It highlights the increased military production, resilience to Western pressure, and development of new trade partnerships.

It is important to note that this is a selective presentation of information and that the Russian economy is facing significant challenges, including high inflation, a shrinking workforce, and a decline in living standards.

Let's dig more into the shadow fleet:

Tell me more what the transcript says about the "shadow fleet". Provide exact quotes to support your conclusions.

This provides a relatively brief summary:

The transcript describes the "shadow fleet" as a response by the Kremlin to Western sanctions on Russian oil. It is presented as a sign of Russia's economic resilience and its ability to circumvent Western attempts to restrict its access to global markets.

Here are some exact quotes from the transcript about the shadow fleet:

Overall, the transcript presents the shadow fleet as a successful strategy by Russia to maintain its oil exports and generate revenue despite Western sanctions. It is portrayed as a sign of Russia's economic strength and its ability to adapt to changing circumstances.

It is important to note that the shadow fleet is a controversial topic and that there are concerns about its environmental and safety implications. Additionally, the effectiveness of the shadow fleet in circumventing Western sanctions is disputed.

For reference, here is one excerpt from the English version of the transcript about the shadow fleet:

The shadow fleet is a term that unites about 100 tankers that transport Russian oil and petroleum products , bypassing Western sanctions, to the ports of the oil-rich United Arab Emirates and Saudi Arabia. Gulf, who want to benefit from Russian oil. The shadow fleet is the Kremlin’s response to the West’s introduction of price limits on its oil in December 2022 . The restrictions mean that Western companies can transport, trade or ensure supplies of Russian oil only if it sells for $60 a barrel or less. Russia's action was exactly the opposite, they began to build their own shipping, they began to create their own insurance. The provider of ship tracking and maritime analytics services has identified dozens of tankers that it says meet the criteria of a shadow fleet vessel. This vessel operates almost exclusively with Russian oil and petroleum products. The company has changed owner after Russia began its full-scale invasion of Ukraine in 2022 and operates almost exclusively in countries such as the United Arab Emirates, India and China. While most shadow tankers head to India and China, many have made their way through oil-rich countries such as Saudi Arabia and the United Arab Emirates. You can buy Russian diesel fuel in Saudi Arabia and use it domestically, thereby gaining more opportunities for export to Europe. Saudi Arabia exports 250,000 barrels of diesel fuel per day to Europe , almost doubling the total flow of Middle Eastern products into the European market. Suppliers of Russian diesel fuel to Saudi Arabia have reached 100,000 barrels per day in 2023, up from virtually zero before the war in Ukraine, and the United Arab Emirates has become a major hub.

Can we make a list of all of the sanctions-related locations and companies that the transcript mentions?

Provide a list of all of the cities, countries and companies involved in the "shadow fleet" and sanctions evasion that are mentioned in the transcript. Provide a bulleted list and a sample quote from the transcript mentioning each.

While reasonable, the results are less detailed and there are a few errors in the quotes provided below. Nonetheless, this workflow offers a powerful glimpse at the ability to triage for specific entities involved in sub elements of complex stories:

Cities, Countries, and Companies Involved in the "Shadow Fleet" and Sanctions Evasion

Here is a bulleted list of the cities, countries, and companies mentioned in the transcript in relation to the "shadow fleet" and sanctions evasion, along with a sample quote for each:

Countries:

"The shadow fleet is the Kremlin's response to the West's introduction of price caps on its oil in December 2022."

"Dubai has become the new Geneva for Russian oil companies."

"You can buy Russian diesel fuel in Saudi Arabia and use it domestically, thereby freeing up more opportunities for exports to Europe."

"While most shadow tankers head to India and China…"

"…many have made their way through oil-rich Gulf countries such as Saudi Arabia and the United Arab Emirates."

Cities:

"Dubai has become the new Geneva for Russian oil companies."

"Once unloaded, the fuel can largely disappear into the vast pool of tankers present at Fujairah."

Companies:

It is important to note that this list is not exhaustive and that other cities, countries, and companies may be involved in the "shadow fleet" and sanctions evasion.

Returning to the war, let's go back and drill into the casualties question:

What does it say about both Russian and Ukrainian casualties in the invasion of Ukraine? Provide quotes to support your conclusions.

Interestingly, Gemini calls out that Russian casualty counts are vague, even as Ukrainian losses are detailed, which is to be expected, but it is fascinating to see Gemini call this out explicitly:

The transcript acknowledges that both Russian and Ukrainian forces have suffered heavy casualties in the invasion of Ukraine. However, it provides more specific information about Ukrainian losses, while remaining relatively vague about Russian casualties.

Here are some quotes from the transcript about casualties:

Ukrainian casualties:

Russian casualties:

Overall, the transcript provides more concrete information about Ukrainian casualties than Russian casualties. This is likely due to the transcript's pro-Russian bias. However, it does acknowledge that the war has been costly for both sides in terms of human life.

It is important to note that casualty figures are often disputed in wartime, and it is difficult to obtain accurate and reliable information.

Knowing that the transcript is extremely pro-Russian, let's ask Gemini its opinion:

Is the transcript more pro-Russian or more pro-Ukrainian. Explain your reasoning step-by-step and provide specific examples from the text to support your conclusions. Are there specific topics that are more pro-Russian or more pro-Ukrainian in the text?

Gemini correctly ascertains its overall tenor:

Transcript Bias: Pro-Russian or Pro-Ukrainian?

Based on a careful analysis of the text, the transcript is more pro-Russian than pro-Ukrainian. Here's a step-by-step explanation with specific examples:

Pro-Russian Bias:

Examples:

Pro-Ukrainian Bias:

While the transcript is predominantly pro-Russian, there are a few instances where it acknowledges Ukrainian perspectives:

Examples:

Specific Topics:

In conclusion, the transcript is predominantly pro-Russian in its coverage of the invasion of Ukraine. It presents a narrative that emphasizes Russian strength, Ukrainian weakness, and Western cynicism. However, it does occasionally acknowledge Ukrainian perspectives and the human cost of the war.

It is important to be aware of this bias when interpreting the information presented in the transcript.