The GDELT Project

Transcribing 2.5M Hours Of TV News: Comparing Google Translate, GPT-4, Gemini Ultra & Gemini Pro 1.5 For Trilingual Translation

Continuing our comparisons of multilingual machine translation of global television news, how do Google Translate, GPT-4, Gemini Ultra & Gemini Pro 1.5 compare in their translations into English of a trilingual passage?

The end result is that GPT-4 produces a strong and seamlessly blended translation, while Gemini Pro 1.5 consistently fragments the text on linguistic boundaries. While Gemini Ultra produces a translation, it is disfluent and includes multiple bizarre lines like "Kuwait men's double-flying saucer event" and "training in the system to check dangerous goods".

Translate the following text into English:

I have been there for two times already when I was 15 years ago when I still um first mayor then of Tagaytay so now it's definitely it's very beautiful and very developed this will be a different concept now uh the… beauty and the combination of the beauty of the city, the natural beauty and the high technology combination of both, the lake, artificial intelligence, all the the new technologies now in Hango, before it was different, much more today,本菲的運動有400名多, four years ago, five years ago in in Indonesia. 今 年 科 威 特 男 子 双 向 飞 迪 相 目 共 有 三 名 运 动 员 参 赛 。 这 位 在 训 练 建 系 优 险 品 查 的 运 动 员 叫 阿 布 都 拉 拉 西 敌 , 是 克 菲 特 飞 碟 射 击 队 的 传 期 人 物 , 曾 获 得 过 多 个 世 界 比 赛 冠 军 , 两 界 亚 运 会 设 计 比 赛 的 金 牌 。 在 2010 年 的 广 洲 亚 运 会 上 , 他 第 一 次 实 现 了 自 己 的 亚 运 金 牌 梦 。 今 年 60 岁 的 他 将 继 续 出 展 , 和 儿 子 曼 苏 尔 拉 西 敌 一 起 代 表 科 微 特 参 加 韩 州 亚 运 阿 布 独 拉 的 儿 子 曼 苏 尔 是 2018 年 亚 加 亚 运 会 , 男 子 双 向 飞 蝶 个 人 相 目 的 冠 军 。 بانها تكون في الصين لاني في 2010 اخذت البطوله في الصين والان ان شاء الله راح ارجع الصين واخذها بالصين انا بطل اسياد اسيا السابق 2018 فا ودي احرص على لقبي في هذه البطوله. وكانت مع بحثنا في القريه الاولمبيه الاسيويه اللي في الصين كانت مشوقه وكانت تعطينا طابع حلو انه نكون نشارك ونشوف المرافق الصينيه بابداعاتهم الحلوه لقد تم تجهيز امتعتي بالكامل وانا جاهز با 近 日 国 家 计 算 机 病 毒 应 集 处 理 中 心 和

As usual, Google Translate latches onto a single non-English language to translate (in this case Chinese) and fails to translate the Persian:

I have been there for two times already when I was 15 years ago when I still um first mayor then of Tagaytay so now it's definitely it's very beautiful and very developed this will be a different concept now uh the… beauty and the combination of the beauty of the city, the natural beauty and the high technology combination of both, the lake, artificial intelligence, all the the new technologies now in Hango, before it was different, much more today, Benfi’s movement has more than 400 people, four years ago, five years ago in Indonesia. This year, three athletes participated in the Kuwaiti men's two-way competition. This athlete who is training and building a quality inspection team is called Abdullah Laxidi. He is a legendary figure of the Kefeit UFO shooting team. He has won multiple world competition championships and two gold medals in the Asian Games design competition. . At the 2010 Guangzhou Asian Games, he realized his dream of winning an Asian Games gold medal for the first time. At the age of 60 this year, he will continue to participate in exhibitions and represent Kuwait in the Korean Asian Games with his son Mansoor Rasif. Abdullah’s son Mansoor was the champion of the men’s two-way butterfly individual event at the 2018 Asian Games. . بانها تكون في الصين لاني في 2010 اخذت البطوله في الصين والان ان شاء الله راح ارجع الصين واخ ذها بالصين انا بطل اسياد اسيا السابق 2018 فا ودي احرص على لقبي في هذه البطوله. بحثنا في القريه الاولمبيه الاسيويه اللي في الصين كانت مشوقه وكانت تعطينا طابع حلو انه نكون نشارك ونشوف المرافق الصينيه بابداعاتهم الحلوه لقد تم تجهيز امتعتي بالكامل وانا جاهز با Recently, the National Computer Virus Response Center and

GPT-4 produces a seamlessly blended translation:

I have visited there twice already, once 15 years ago when I was the first mayor of Tagaytay. Now, it's truly beautiful and well-developed. This will offer a different concept—the beauty and the combination of the city's natural beauty with high technology, including the lake and artificial intelligence, as well as all the new technologies now in Hango. Before, it was different, much more so today. The sports event in Benfi involved more than 400 athletes, four years ago, five years ago in Indonesia. This year, three athletes participated in the bi-directional flying disc event in Kuwait. One of the athletes, Abdulrahman Al-Sadiq, is a key figure in Kuwait's flying disc shooting team and has won several world championships and two gold medals at the Asian Games design competition. In the 2010 Guangzhou Asian Games, he realized his dream of winning an Asian Games gold medal. This year, at the age of 60, he will continue to compete alongside his son, Mansour Al-Sadiq, who is the 2018 Asian Games champion in the men’s bi-directional butterfly individual event. I want to defend my title in this competition in China, as I won the championship there in 2010, and God willing, I will return to China and win it again. My previous experience at the Asian Games in 2010 in the Olympic Village in China was fascinating and gave us a wonderful sense of participation and the opportunity to see the Chinese facilities and their creative achievements. My luggage is fully packed, and I am ready. In the coming days, the National Computer Virus Emergency Response Center will be involved.

Unfortunately, Gemini Ultra produces a disjointed translation that is both confusing to follow and includes strange lines like "Kuwait men's double-flying saucer event" and "training in the system to check dangerous goods":

I have been there twice already, 15 years ago when I was the mayor of Tagaytay. Now it's definitely very beautiful and developed. This will be a different concept now, combining the beauty of the city, the natural beauty, and high technology. The lake, artificial intelligence, all the new technologies are now in Hango. Before it was different, much more so today.

(The following text is a mix of Chinese, Arabic, and potentially other languages. The translation is fragmented due to the disjointed nature of the text.)

…Benfei's sports have more than 400 people, four years ago, five years ago in Indonesia. This year's Kuwait men's double-flying saucer event has a total of three athletes participating. This athlete, who is training in the system to check dangerous goods, is called Abdullah Rasi, a legendary figure of the Kuwait Frisbee shooting team, who has won multiple world championships and two Asian Games design competitions. Gold medal. At the 2010 Guangzhou Asian Games, he realized his Asian Games gold medal dream for the first time. This year, the 60-year-old will continue to play and represent Kuwait with his son Mansour Rasi to participate in the Hangzhou Asian Games. Abdullah's son Mansour was the 2018 Asian Games men's double flying butterfly individual champion. … because in 2010 I took the championship in China and now, God willing, I will return to China and take it in China. I am the former Asian champion in 2018, so I would like to keep my title in this tournament. And it was with our research in the Asian Olympic Village, which is in China, it was exciting and gave us a sweet character that we participate and see the Chinese facilities with their sweet creations. My luggage has been fully packed and I am ready…

…Recently, the National Computer Virus Emergency Response Center and…

Gemini Pro 1.5 produces an even more fragmented translation:

The provided text is a mix of English, Filipino, Chinese, and Arabic. Let's break it down and translate:
English:
"I have been there for two times already when I was 15 years ago when I still um first mayor then of Tagaytay so now it's definitely it's very beautiful and very developed this will be a different concept now uh the… beauty and the combination of the beauty of the city, the natural beauty and the high technology combination of both, the lake, artificial intelligence, all the the new technologies now in Hango, before it was different, much more today"
This section describes someone's impressions of a place (possibly Tagaytay) that has undergone significant development, contrasting its present beauty and technological advancement with its past.
Filipino:
"400名多"
This phrase appears within the Chinese text and translates to "more than 400 people."
Chinese:
"本菲的運動有400名多, four years ago, five years ago in in Indonesia. 今年科威特男子双向飞碟项目共有三名运动员参赛。这位在训练建系优先品查的运动员叫阿布都拉拉西敌, 是克菲特飞碟射击队的传奇人物, 曾获得过多个世界比赛冠军, 两界亚运会射击比赛的金牌。在2010年的广州亚运会上, 他第一次实现了自己的亚运金牌梦。今年60岁的他将继续出展, 和儿子曼苏尔拉西敌一起代表科威特参加韩州亚运阿布独拉的儿子曼苏尔是2018年亚加亚运会, 男子双向飞碟个人项目的冠军。"
"近日国家计算机病毒应急处理中心和"
This section discusses Kuwaiti athletes participating in the Asian Games, specifically focusing on a 60-year-old athlete named Abdullah Al-Rashidi who will compete alongside his son. It mentions his past achievements and aspirations for the upcoming games. The last Chinese phrase is incomplete and seems to be related to a national computer virus emergency response center.
Arabic:
"بانها تكون في الصين لاني في 2010 اخذت البطوله في الصين والان ان شاء الله راح ارجع الصين واخذها بالصين انا بطل اسياد اسيا السابق 2018 فا ودي احرص على لقبي في هذه البطوله. وكانت مع بحثنا في القريه الاولمبيه الاسيويه اللي في الصين كانت مشوقه وكانت تعطينا طابع حلو انه نكون نشارك ونشوف المرافق الصينيه بابداعاتهم الحلوه لقد تم تجهيز امتعتي بالكامل وانا جاهز با"
This section translates to:
"I want it to be in China because in 2010 I won the championship in China, and now, God willing, I will return to China and take it in China. I am the former Asian Games champion in 2018, so I want to maintain my title in this tournament. Our exploration of the Asian Olympic Village in China was exciting, and it gave us a nice feeling to participate and see the Chinese facilities with their beautiful innovations. My luggage is fully packed, and I am ready."
This is likely Abdullah Al-Rashidi speaking, expressing his desire to win again in China and his excitement about the facilities.
Overall, the text appears to be a compilation of different sources discussing a place's development, athlete profiles, and personal statements from athletes, particularly focusing on Abdullah Al-Rashidi and his participation in the Asian Games.