Discrimination, Bias & Western Utopia In LLM-Based Machine Translation
Yesterday we explored how LLM-based machine translation poses novel challenges to translation workflows, encoding a set of "Western values" that…
When Machine Translation Begins To Encode "Values": LLMs, Editorialization & Guardrails
For the long history of machine translation, from rules-based to SMT to NMT, translation systems were designed to be neutral…
More Experiments With DOC 2.0 API + LLMs = Summarizing Headlines: Turkish Investment, Inflation & The Niger Coup
Last month we explored using ChatGPT (GPT-3.5) to summarize search results from the DOC 2.0 API for at-scale landscape summarization…
35th MINDS Conference Toronto: The Promise & Perils Of AI For Journalism: Lessons Learned From A Quarter-Century Of Using AI To Catalog The Planet Through News
We're tremendously excited to announce that Kalev will be speaking at the 35th MINDS Conference in Toronto next month! From…
More Experiments With LLM Translation: GCP's PaLM Vs ChatGPT For Headline Translation
Continuing our LLM translation experiments, let's compare PaLM to ChatGPT (GPT-3.5) for news headline translation in which the majority of…
More Experiments With LLM Translation: Translation Stability In GCP's PaLM Vs ChatGPT
Continuing our series evaluating LLM translation capabilities, we'll have PaLM and ChatGPT translate two paragraphs from a Chinese language news…
More Experiments With LLM Translation: GCP's PaLM Vs ChatGPT Vs Google Translate On News Translation
With the General Availability of Chinese language support in Google's PaLM LLM, let's repeat our full-length news media translation experiments, comparing…
More Experiments With LLM Translation: GCP's PaLM Vs ChatGPT Vs Google Translate On Social Media Translation
With the General Availability of Chinese language support in Google's PaLM LLM, let's repeat our Weibo social media post translation experiments,…
WashPost: Be Glad You're Not In Charge Of Raising Money For Ron DeSantis
The Washington Post's Philip Bump examines media coverage of DeSantis. Read The Full Article.
More Experiments With LLM Translation: GCP's PaLM On Government Translation
With the General Availability of Chinese language support in Google's PaLM LLM, let's repeat our earlier tests of LLM-based translation…
RCP: Generative AI Is More Mad Lib Than HAL9000
A quiet revolution has been occurring in artificial intelligence. Whereas in the past, AI was limited to analyzing information that…
Experiments With GCP's Chirp: An Example Of Multilingual Transcription
Television news across the world frequently contains excerpts of languages other than the dominate language of the broadcast, either through…
More Experiments Visually Describing TV News Using Google's Imagen Generative AI Image Captioning
Earlier this month we examined Imagen on Vertex AI, Google's new image-based generative AI foundational model for images, applying it to…
The Challenges Of LLM-Powered Code Generators: Early Observations From The Trenches
A growing body of research is beginning to call into question the quality of LLM-generated code, even as the tech…
Major New Chirp Demo Coming Soon
Stay tuned for a massive new demo of Chirp applied to the Visual Explorer!
Modern Monetary Theory (MMT) Has Faded In The Media
Modern Monetary Theory (MMT) rocketed into the media limelight in January 2019, peaking in March of that year and remaining…
Getting Started With GCP's Chirp / Universal Speech Model (USM) Multilingual Speech Transcription: Transcribing A 2.5 Hour Russian Broadcast In 4 Minutes
How can you leverage GCP's powerful Universal Speech Model (USM) known as "Chirp" for multilingual speech transcription? USM is a "family…
CEPR: Black Tulips And The Russian War In Ukraine
A look at protests and coverage of casualties in Russia's invasion of Ukraine. Read The Full Article.
Slator: Meta Debuts SeamlessM4T, The Swiss Army Knife Of Translation Models
Slator referenced our analyses of Meta's new SeamlessM4T model in their coverage of its release. Read The Full Article.
Experiments With Speech Transcription & Translation: Meta's SeamlessM4T Vs OpenAI's Whisper Vs GCP's STT+GT Vs GCP's USM/Chirp+GT
As the final piece in our our series of evaluating Meta's new SeamlessM4T multimodal translation model, let's evaluate its speech transcription and…
Experiments With Meta's SeamlessM4T Open Machine Translation Model: Medium Model Outperforming Large Model
Continuing our series of evaluating Meta's new SeamlessM4T multimodal translation model, there are actually two versions of the model: large and medium. We've…
Experiments With Meta's SeamlessM4T Open Machine Translation Model: News Articles
Continuing our series of evaluating Meta's new SeamlessM4T multimodal translation model, let's expand our social media experiments with a full-length news article. While…
Experiments With Meta's SeamlessM4T Open Machine Translation Model: Social Media Posts
Continuing our series of evaluating Meta's new SeamlessM4T multimodal translation model. Let's try translating some Weibo social media posts that…
Experiments With Meta's SeamlessM4T Open Machine Translation Model: Government Publication Translations
Yesterday, Meta announced its new SeamlessM4T multimodal translation model. Let's run a quick simple benchmark of its textual Chinese to…