Continue Reading

LMMs & Google's Gemini 1.5 Pro Watching Television News: Returning To Second-By-Second Visual Descriptions Through Video & Surrogates

As continue to examine Gemini's video capabilities, let's return to our work on second-by-second visual descriptions using a series of…

Continue Reading

LMMs & Google's Gemini 1.5 Pro Watching Television News: Boosting Gemini To 2.5 Hours Of Video + Summarization

Yesterday we explored boosting Gemini's video capabilities from its native one hour to 2.5 hours by overriding its sampling process…

Continue Reading

LMMs & Google's Gemini 1.5 Pro Watching Television News: Overriding Gemini's Sampling To Extend Its Context Window To 2.5 Hours

Google's new Gemini 1.5 Pro LMM model accepts videos up to one hour in length and internally samples them into…

Continue Reading

More Experiments With Gemini's Video Capabilities: Pushing Beyond The 1 Hour Limit

Stay tuned tomorrow for a first look at pushing Gemini beyond its default one hour input limitation for videos by…

Continue Reading

#MeToo Has Largely Faded Away On Television News

The term #MeToo burst into the media in late 2017 , but largely faded from CNN and MSNBC by late…

Continue Reading

LMMs & Google's Gemini 1.5 Pro Watching Television News: Using Image Surrogates To Summarize A Russian TV News Clip Into Stories

Yesterday we demonstrated how Google's Gemini 1.5 Pro's video analysis capabilities make it possible to take a 6 minute clip…

Continue Reading

Why Gemini 1.5 Pro Describes President Biden As "Confused" & "Disoriented" And What It Tells Us About Training Data

One of the more fascinating findings from our experiments with Gemini 1.5 Pro's video capabilities is how strongly it associates…

Continue Reading

LMMs & Google's Gemini 1.5 Pro Watching Television News: Visually Summarizing A Russian TV News Clip Into Stories

As we continue to explore Gemini 1.5 Pro's video analysis capabilities, we've examined a number of different prompt approaches to…

Continue Reading

LMMs & Google's Gemini 1.5 Pro Watching Television News: Visually Summarizing A 30-Minute Evening News Broadcast In One Prompt

As we continue to explore Google's Gemini 1.5 Pro model's native video capabilities, what if we scale our analysis from…

Continue Reading

Gemini 1.5 Pro's 1 Million Token Model: Can Prompt Engineering Improve Its "Needle In A Haystack" Performance?

Yesterday we were surprised to discover sharply reduced performance from Gemini 1.5 Pro on our RW-NIAH (Real World Needle In…

Continue Reading

Gemini 1.5 Pro's 1 Million Token Model: How Its "Needle In A Haystack" Performance On One Broadcast Collapsed to 0% Accuracy Over The Last 2 Weeks

Two weeks ago we examined Gemini 1.5 Pro's NIAH (Needle In A Haystack) performance, finding that when asked to identify…

Continue Reading

Early Findings With Gender, Racial & Cultural Bias In Generative AI Embeddings, Models & Guardrails

As we continue to explore how various generative AI offerings from different companies perform across global news coverage, one area…

Continue Reading

LMMs & Google's Gemini 1.5 Pro Watching Television News: Summarizing A Video Second-By-Second With Keywords & Descriptions

As we continue our experiments with having Google's Gemini 1.5 Pro model visually analyze a 6-minute video clip from Russian…

Continue Reading

LMMs & Google's Gemini 1.5 Pro Watching Television News: The Instability Of Summarizing Video

Yesterday we explored Google's Gemini 1.5 Pro model's video analysis capabilities by asking it to analyze a 6-minute clip of…

Continue Reading

LMMs & Google's Gemini 1.5 Pro Watching Television News: First Results From Watching A Russian TV News Clip

One of the most powerful capabilities of Google's new Large Multimodal Model (LMM) Gemini 1.5 Pro model is its ability…

Continue Reading

How We Transcribed 2.5 Million Hours Of TV News In Just 7 Days & How We Could Have Finished In A Single Afternoon

On Wednesday, we announced in collaboration with the Internet Archive TV News Archive the machine transcription of its complete 2.5…

Continue Reading

Transcribing 2.5M Hours Of TV News: What Does A GCP USM Chirp JSON Transcript Look Like?

Yesterday we announced the complete machine transcription of the Internet Archive TV News Archive's complete 2.5 million hours of uncaptioned…

Continue Reading

Transcribing The TV News Archive's 2.5-Million-Hour Quarter-Century Archive Of Global Television News

The Internet Archive's Television News Archive today preserves global television news coverage encompassing selections from 108 channels spanning 50 countries…

Continue Reading

WashPost: Why A Fox News Pundit May Not Have Heard Bad News About Trump

The Washington Post's Philip Bump explores the parallel media universes of cable television news. Read The Full Article.

Continue Reading

Visual Explorer: Stay Tuned For A Massive Announcement This Week

Stay tuned for a truly incredible announcement coming this week.

Continue Reading

Whisper Vs Chirp: The Hidden GPU Cost Of "Free" AI Models & Why Commercial Hosted Models Can Be Far Cheaper

The rapid proliferation of impressively capable "free" open source AI models with one-click installations and simplified workflows means companies increasingly…

Continue Reading

Behind The Scenes: GCP IAP + GNU Screen For One-Off Manual Workloads

There are many use cases like diagnosing an intermittent service fault, testing a new service or performing basic analytics like…

Continue Reading

Frontiers In Research Metrics & Analytics: Cascaded Semantic Fractionation For Identifying A Domain In Social Media

Searching social media to find relevant semantic domains often results in large text files, many of which are irrelevant due…

Continue Reading

Atlantic Council: After Prigozhin, Russia Clamps Down Online

The Atlantic Council's Digital Forensic Research Lab (DFRLab) includes an analysis of Russian television news. Read The Full Article.