Following on our experiments with combining the DOC 2.0 API and LLMs like PaLM or ChatGPT to summarize global headlines, what would it look like to run a search for all coverage containing the word "outbreak" (excluding Covid coverage) over the past week and generating a global country-level summary? Such summarization requires three tasks: filtering (removing headlines that aren't truly about an outbreak such as an "outbreak" of violence), translation (translating from the DOC 2.0 API's 65 different languages into English) and summarization (weaving the resulting list of translated relevant headlines into a cohesive narrative). Here we examine two different workflows: combine all three steps into a single prompt (the cheapest and simplest) or separate into three separate tasks and run each individually (this increases the cost 3x but allows the LLM to focus individually on each task, which can often yield improved results). For the latter we test filtering->translation->summarization vs translation->filtering->summarization pipelines to see if the task ordering makes a difference. The end result is that at least with PaLM and ChatGPT (GPT-3.5), the combined single-pass prompt yields the best and most comprehensive results, but at a cost of a higher false positive rate of non-disease-related stories that can be easily skipped by downstream analysts.
Let's use a simple query of "outbreak -covid". This isn't an ideal query in that it will return unrelated coverage like "outbreak of violence", but offers a trivial starting point for a quick demo. Let's use a simple prompt to summarize by country in English:
Summarize the following list of news article headlines that are written in different languages into a detailed summary in English, making sure to incorporate all of the detail from the different headlines in a single summary. Ignore headlines that do not relate to a disease outbreak. Break the summary down by country.
Our prompt and headlines (duplicates were not removed):
time curl \
-X POST \
-H "Authorization: Bearer $(gcloud auth print-access-token)" \
-H "Content-Type: application/json" \
https://us-central1-aiplatform.googleapis.com/v1/projects/[YOURPROJECTID]/locations/us-central1/publishers/google/models/text-bison:predict -d \
$'{
"instances": [
{ "prompt": "Summarize the following list of news article headlines that are written in different languages into a detailed summary in English, making sure to incorporate all of the detail from the different headlines in a single summary. Ignore headlines that do not relate to a disease outbreak. Break the summary down by country. HEADLINES:\nNamibia Conducts Crimean Congo Haemorrhagic After - Action Review
Hà Nội: Số mắc sốt xuất huyết ở Đống Đa và Cầu Giấy tăng vọt
Hà Nội: Số mắc sốt xuất huyết ở Đống Đa và Cầu Giấy tăng vọt
Πάτρα: Ολοκληρώθηκε η κατεδάφιση των δύο σεισμόπληκτων κτιρίων της φοιτητικής εστίας ( pics )
Hà Nội ghi nhận hơn 1.000 ca sốt xuất huyết trong 1 tuần
Calgary daycare E.coli outbreak continues to add numbers - Calgary
Alberta Premier sends thoughts and prayer to E.coli patients one week after outbreak
母娘のバトル勃発 ！？ 誕生日プレゼントで意見が割れて大波乱 ！！ そして … ＜癇癪持ちの気持ち＞ ( 2023年9月6日 ) ｜ウーマンエキサイト ( 1 / 2 )
Uttarakhand: Dengue outbreak sweeps through Dehradun,prompting urgent action
Viral Video: ಏಕಾಏಕಿ ಬಸ್ ಮೇಲೆ ದಾಳಿ ನಡೆಸಿದ ಆನೆ,ಪ್ರಯಾಣಿಕರು ಕಂಗಾಲು !
جو 24: أول طائرة مدنية مصرية تحط في السودان منذ اندلاع الأزمة
Hà Nội thêm hơn 1.000 ca sốt xuất huyết trong một tuần,dịch vẫn diễn biến phức tạp
Namibia Conducts Crimean Congo Haemorrhagic After - Action Review
Ottawa ready to help as Alberta daycare E.coli outbreak grows
我们这两个邻国 ， 边境突然爆发冲突 _ 军事频道 _ 中华网
Parent Initiates Class - Action Lawsuit Following E.Coli Outbreak at Calgary Daycares
Dialysis machines brought in to treat children in Calgary daycare E.coli outbreak
E.coli cases continue to rise after outbreak from Calgary daycares
Taraba govt denies outbreak of Anthrax
Dominicana atraviesa brote epidémico de dengue
Die gefährlichsten Vulkane der Welt: Top 10
حرق المصحف: اندلاع أعمال شغب وصفت بـ العنيفة حدثت بعد حرق المصحف في البلاد
让二追三 ！ 陈梦王曼昱上演神剧情 ， 淘汰日本组合 ， 绝境爆发怒吼
نشوب حريق في محل لخدمات الإنترنت بإمبابة في الجيزة
Alberta premier asks ministers for full assessment of E.coli outbreak in Calgary – Winnipeg Free Press
香港四邑商工總會陳南昌紀念中學 潛能大爆發 - 明校網 - 全港幼稚園 、 小學 、 中學及國際學校資訊平台
रोगले सुक्न थाले सुन्तला
اندلاع حريق داخل شقة سكنية بالشرقية ( صور )
96 cases linked to Calgary daycare E.coli outbreak: AHS update - Calgary
Pd,Orlando sui 31 dirigenti liguri che hanno lasciato il partito: Uscite a scoppio ritardato,noi in passato siamo rimasti
大爆发 ！ 最牛连拉8涨停 ， 无人驾驶板块异动拉升 ， CRO板块重回下降通道 - 股票 - 金融界
如果台海冲突爆发 ， 美军一周内就会耗尽弹药 ？_ 军事频道 _ 中华网
96 lab - confirmed cases linked to E.coli at Calgary daycares,22 kids in hospital: AHS
Italien: Supervulkan bedroht Millionen Menschen in Süditalien – Experte mit Einschätzung
False claims of an Ebola outbreak at the Burning Man concert
Cel mai grav focar de febră dengue din istorie
« Έρωτας φυγάς » spoiler: Το άγριο ξέσπασμα της Ευγενίας
Phlegräische Felder: Europas Supervulkan droht auszubrechen
Alberta premier asks ministers for full assessment of E.coli outbreak in Calgary
Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital – Winnipeg Free Press
Calgary daycares hit by E.coli outbreak could be shut down for another week - Canada News
Calgary daycares hit by E.coli outbreak could be shut down for another week - Canada News
Se registra conato de incendio en local de bulevar Francisco Villarreal
Έτσι θα μοιάζουν οι φοιτητικές εστίες στην παλιά Λευκωσία ( pics )
Officials say some patients showing severe symptom in Calgary daycare outbreak - Canada News
Officials say some patients showing severe symptom in Calgary daycare outbreak - Canada News
Officials say some patients showing severe symptom in Calgary daycare outbreak - Canada News
Officials Say Some Patients Showing Severe Symptom in Calgary Daycare Outbreak
Un joven bajo un brote psicótico amenazó y tomó a sus padres como rehenes en Córdoba
Burning Man 2023 FEMA and Ebola outbreak rumors debunked
Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital - Canada News
Morre policial militar alvejado por homem em surto em Itirapina
tayyar.org - كتل هوائية حارة مصدرها مصر .. وارتفاع ملحوظ بدرجات الحرارة !
Officials say some patients showing severe symptom in Calgary daycare outbreak
AMD - Bullische Konsolidierung ?
Conato de incendio en local de sistemas de aire acondicionado
القبض على شاب قتل آخر طعنا بسلاح أبيض في حفل زفاف بأسيوط
Hà Nội: Dịch sốt xuất huyết vẫn diễn biến phức tạp
E.coli outbreak sends at least 50 children to hospital in Calgary
نشوب حريق هائل بعقار مكون من 5 طوابق بمنطقة الحي العاشر في 6 أكتوبر
দেশে আরও ১৭ জনের শরীরে করোনা শনাক্ত
本周国防军工行业大涨4.3 %， 传媒行业重挫逾6 %， 华为产业链爆发 ， 光刻胶 、 光刻胶 、 卫星通信等题材全线崛起
Italien: Supervulkan könnte Neapel vernichten – Vulkanologe gibt Einschätzung
Bangladesh hit by worst dengue outbreak on record,says WHO
Legionnaire disease outbreak in southeast Poland on decline with only 1 new case reported
Rumours of Ebola outbreak at Burning Man Festival - here why theyre false
Πανεπιστήμιο Πατρών: Πάνω από 100 δωμάτια έτοιμα μέχρι την έναρξη της νέας χρονιάς
Cách phòng tránh sốt xuất huyết khi sống trong khu vực có ổ dịch
بالفيديو: إطلاق نار ودوي قذائف في مخيم عين الحلوة - Lebanese Forces Official Website
Alberta health officials report 128 lab - confirmed cases of E.coli linked to outbreak at daycares
3小時抓到 「 3位RSV小孩 」！ 主要症狀曝光 醫師 ： 今夏異常爆發 | 生活 | 三立新聞網 SETN.COM
普京接连收到三大好消息 ： 拜登特朗普互相炮轰 ！ 乌内部爆发内讧 _ 连斯基 _ 严重 _ 美国
بقايا سيجارة تُشعل حريقًا بشقة وإصابة مالكها فى سوهاج
WHO: Bangladesh hit by worst dengue outbreak on record
La búsqueda del foco del brote de legionela de Cáceres no da resultados por el momento"}
],
"parameters": {
"temperature": 0.2,
"maxOutputTokens": 2048,
"topK": 40,
"topP": 0.95
}
}' > O; cat O | jq -r .predictions[0].content
PaLM:
**Namibia**
Namibia has conducted a Crimean Congo Haemorrhagic Fever After-Action Review.
**Vietnam**
Hanoi, Vietnam has seen a surge in dengue fever cases in the districts of Dong Da and Cau Giay. In just one week, Hanoi recorded over 1,000 dengue fever cases, and the outbreak shows no signs of slowing down.
**Greece**
In Patra, Greece, two earthquake-damaged buildings at the student residence have been demolished.
**Canada**
An E.coli outbreak continues to grow at daycare centers in Calgary, Alberta. The outbreak has now spread to 96 lab-confirmed cases, with 22 children hospitalized. The daycares affected by the outbreak could be shut down for another week.
**India**
An outbreak of dengue fever has swept through Dehradun, Uttarakhand, prompting urgent action from authorities.
**Dominican Republic**
The Dominican Republic is currently experiencing a dengue fever outbreak.
**Italy**
Mount Vesuvius, one of the world's most dangerous volcanoes, is threatening millions of people in southern Italy, according to experts.
**Egypt**
A fire broke out at an internet service shop in Imbaba, Giza.
**Bangladesh**
Bangladesh is currently experiencing its worst dengue fever outbreak on record, according to the World Health Organization (WHO).
**Poland**
A Legionnaire's disease outbreak in southeast Poland is on the decline, with only one new case reported.
**United States**
Burning Man 2023: FEMA and Ebola outbreak rumors debunked.
ChatGPT:
In various countries, there are several headlines related to disease outbreaks, with a focus on E.coli and dengue outbreaks:
**Canada (Calgary):**
– An E.coli outbreak in Calgary daycares has affected dozens of children and may lead to the closure of these facilities for another week. The outbreak is linked to at least 96 lab-confirmed cases, with 22 children hospitalized.
**Vietnam (Hà Nội):**
– Hà Nội has seen a significant increase in dengue fever cases, with over 1,000 cases reported in a week. Additionally, there is a rising number of cases of hemorrhagic fever in the districts of Đống Đa and Cầu Giấy.
**Namibia:**
– Namibia is conducting an after-action review in response to the Crimean Congo Haemorrhagic outbreak.
**India (Uttarakhand):**
– Dengue outbreak in Dehradun, Uttarakhand, has prompted urgent action.
**Italy:**
– Italy faces a potential threat from a supervolcano in the south of the country, which could affect millions of people.
**Bangladesh:**
– Bangladesh is grappling with its worst dengue outbreak on record, according to the WHO.
**Poland:**
– A Legionnaire disease outbreak in southeast Poland is on the decline, with only one new case reported.
**Lebanon:**
– There have been reports of gunfire and shell explosions in the Ein al-Hilweh camp in Lebanon, although it's not directly related to a disease outbreak.
**Spain (Cáceres):**
– The search for the source of a Legionella outbreak in Cáceres has not yielded results yet.
These headlines provide insights into various disease outbreaks, including E.coli and dengue fever, along with other unrelated events in different countries.
Note that both of these summaries include non-disease related coverage, despite our prompt requesting that non-outbreak headlines be ignored. This is a classic example of non-conformance in which models struggle when presented with multiple tasks to perform in a single pass. Instead, let's do a preprocessing step where we perform filtering and translation:
For each of the news headlines below, translate it into English if it relates to a disease outbreak. If it does not relate to a disease outbreak, delete it.
PaLM:
Namibia Conducts Crimean Congo Haemorrhagic After – Action Review
Calgary daycare E.coli outbreak continues to add numbers – Calgary
Alberta Premier sends thoughts and prayer to E.coli patients one week after outbreak
Uttarakhand: Dengue outbreak sweeps through Dehradun,prompting urgent action
Ottawa ready to help as Alberta daycare E.coli outbreak grows
Parent Initiates Class – Action Lawsuit Following E.Coli Outbreak at Calgary Daycares
Dialysis machines brought in to treat children in Calgary daycare E.coli outbreak
E.coli cases continue to rise after outbreak from Calgary daycares
Taraba govt denies outbreak of Anthrax
Dominicana atraviesa brote epidémico de dengue
96 cases linked to Calgary daycare E.coli outbreak: AHS update – Calgary
Alberta premier asks ministers for full assessment of E.coli outbreak in Calgary – Winnipeg Free Press
96 lab – confirmed cases linked to E.coli at Calgary daycares,22 kids in hospital: AHS
Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital – Winnipeg Free Press
Calgary daycares hit by E.coli outbreak could be shut down for another week – Canada News
Calgary daycares hit by E.coli outbreak could be shut down for another week – Canada News
Officials say some patients showing severe symptom in Calgary daycare outbreak – Canada News
Officials say some patients showing severe symptom in Calgary daycare outbreak – Canada News
Officials say some patients showing severe symptom in Calgary daycare outbreak – Canada News
Officials Say Some Patients Showing Severe Symptom in Calgary Daycare Outbreak
Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital – Canada News
E.coli outbreak sends at least 50 children to hospital in Calgary
Alberta health officials report 128 lab – confirmed cases of E.coli linked to outbreak at daycares
PaLM Second Run:
Namibia Conducts Crimean Congo Haemorrhagic After – Action Review
Calgary daycare E.coli outbreak continues to add numbers – Calgary
Alberta Premier sends thoughts and prayer to E.coli patients one week after outbreak
Uttarakhand: Dengue outbreak sweeps through Dehradun,prompting urgent action
Ottawa ready to help as Alberta daycare E.coli outbreak grows
Parent Initiates Class – Action Lawsuit Following E.Coli Outbreak at Calgary Daycares
Dialysis machines brought in to treat children in Calgary daycare E.coli outbreak
E.coli cases continue to rise after outbreak from Calgary daycares
Taraba govt denies outbreak of Anthrax
Dominicana atraviesa brote epidémico de dengue
96 cases linked to Calgary daycare E.coli outbreak: AHS update – Calgary
Alberta premier asks ministers for full assessment of E.coli outbreak in Calgary – Winnipeg Free Press
96 lab – confirmed cases linked to E.coli at Calgary daycares,22 kids in hospital: AHS
Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital – Winnipeg Free Press
Calgary daycares hit by E.coli outbreak could be shut down for another week – Canada News
Calgary daycares hit by E.coli outbreak could be shut down for another week – Canada News
Officials say some patients showing severe symptom in Calgary daycare outbreak – Canada News
Officials say some patients showing severe symptom in Calgary daycare outbreak – Canada News
Officials say some patients showing severe symptom in Calgary daycare outbreak – Canada News
Officials Say Some Patients Showing Severe Symptom in Calgary Daycare Outbreak
Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital – Canada News
E.coli outbreak sends at least 50 children to hospital in Calgary
Alberta health officials report 128 lab – confirmed cases of E.coli linked to outbreak at daycares
ChatGPT:
Translated headlines related to disease outbreaks:
1. "Hà Nội: Number of dengue fever cases in Đống Đa and Cầu Giấy districts sharply increases."
2. "Hà Nội reports over 1,000 cases of dengue fever in one week, the situation remains complex."
3. "Uttarakhand: Dengue outbreak sweeps through Dehradun, prompting urgent action."
4. "96 cases linked to Calgary daycare E.coli outbreak: AHS update – Calgary."
5. "Officials say some patients showing severe symptoms in Calgary daycare outbreak."
6. "E.coli outbreak sends at least 50 children to hospital in Calgary."
7. "Bangladesh hit by worst dengue outbreak on record, says WHO."
8. "Legionnaire disease outbreak in southeast Poland on the decline with only 1 new case reported."
All other headlines are unrelated to disease outbreaks and have been deleted.
ChatGPT Second Run:
Here are the headlines related to disease outbreaks:
1. Hà Nội: Số mắc sốt xuất huyết ở Đống Đa và Cầu Giấy tăng vọt (Translation: Hanoi: Dengue fever cases surge in Đống Đa and Cầu Giấy).
2. Hà Nội: Số mắc sốt xuất huyết ở Đống Đa và Cầu Giấy tăng vọt (Translation: Hanoi: Dengue fever cases surge in Đống Đa and Cầu Giấy).
3. Hà Nội ghi nhận hơn 1.000 ca sốt xuất huyết trong 1 tuần (Translation: Hanoi records over 1,000 cases of dengue fever in one week).
4. Uttarakhand: Dengue outbreak sweeps through Dehradun, prompting urgent action.
5. Alberta Premier sends thoughts and prayer to E.coli patients one week after outbreak.
6. 96 cases linked to Calgary daycare E.coli outbreak: AHS update – Calgary.
7. Parent Initiates Class-Action Lawsuit Following E.Coli Outbreak at Calgary Daycares.
8. Dialysis machines brought in to treat children in Calgary daycare E.coli outbreak.
9. E.coli cases continue to rise after outbreak from Calgary daycares.
10. Alberta premier asks ministers for full assessment of E.coli outbreak in Calgary.
These headlines are related to disease outbreaks, specifically dengue fever and E.coli outbreaks in various locations. The rest of the headlines do not relate to disease outbreaks and have been deleted.
Strangely, ChatGPT excludes a number of disease-related headlines that PaLM correctly includes. Let's try breaking things down even further into singular tasks. First we'll perform filtering:
For each of the news headlines below, decide whether it mentions a disease outbreak. If it does not relate to a disease outbreak, delete it.
PaLM:
Namibia Conducts Crimean Congo Haemorrhagic After – Action Review
Hà Nội: Số mắc sốt xuất huyết ở Đống Đa và Cầu Giấy tăng vọt
Hà Nội: Số mắc sốt xuất huyết ở Đống Đa và Cầu Giấy tăng vọt
Calgary daycare E.coli outbreak continues to add numbers – Calgary
Alberta Premier sends thoughts and prayer to E.coli patients one week after outbreak
Uttarakhand: Dengue outbreak sweeps through Dehradun,prompting urgent action
Viral Video: ಏಕಾಏಕಿ ಬಸ್ ಮೇಲೆ ದಾಳಿ ನಡೆಸಿದ ಆನೆ,ಪ್ರಯಾಣಿಕರು ಕಂಗಾಲು !
Hà Nội thêm hơn 1.000 ca sốt xuất huyết trong một tuần,dịch vẫn diễn biến phức tạp
Ottawa ready to help as Alberta daycare E.coli outbreak grows
Parent Initiates Class – Action Lawsuit Following E.Coli Outbreak at Calgary Daycares
Dialysis machines brought in to treat children in Calgary daycare E.coli outbreak
E.coli cases continue to rise after outbreak from Calgary daycares
Taraba govt denies outbreak of Anthrax
Dominicana atraviesa brote epidémico de dengue
Die gefährlichsten Vulkane der Welt: Top 10
نشوب حريق في محل لخدمات الإنترنت بإمبابة في الجيزة
Alberta premier asks ministers for full assessment of E.coli outbreak in Calgary – Winnipeg Free Press
96 cases linked to Calgary daycare E.coli outbreak: AHS update – Calgary
Pd,Orlando sui 31 dirigenti liguri che hanno lasciato il partito: Uscite a scoppio ritardato,noi in passato siamo rimasti
96 lab – confirmed cases linked to E.coli at Calgary daycares,22 kids in hospital: AHS
Italien: Supervulkan bedroht Millionen Menschen in Süditalien – Experte mit Einschätzung
Cel mai grav focar de febră dengue din istorie
« Έρωτας φυγάς » spoiler: Το άγριο ξέσπασμα της Ευγενίας
Phlegräische Felder: Europas Supervulkan droht auszubrechen
Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital – Winnipeg Free Press
Calgary daycares hit by E.coli outbreak could be shut down for another week – Canada News
Calgary daycares hit by E.coli outbreak could be shut down for another week – Canada News
Officials say some patients showing severe symptom in Calgary daycare outbreak – Canada News
Officials say some patients showing severe symptom in Calgary daycare outbreak – Canada News
Officials say some patients showing severe symptom in Calgary daycare outbreak – Canada News
Officials Say Some Patients Showing Severe Symptom in Calgary Daycare Outbreak
Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital – Canada News
E.coli outbreak sends at least 50 children to hospital in Calgary
Officials say some patients showing severe symptom in Calgary daycare outbreak
Bangladesh hit by worst dengue outbreak on record,says WHO
Legionnaire disease outbreak in southeast Poland on decline with only 1 new case reported
ChatGPT:
Here are the headlines that mention a disease outbreak:
1. Hà Nội: Số mắc sốt xuất huyết ở Đống Đa và Cầu Giấy tăng vọt
2. Hà Nội: Số mắc sốt xuất huyết ở Đống Đa và Cầu Giấy tăng vọt
3. Hà Nội ghi nhận hơn 1.000 ca sốt xuất huyết trong 1 tuần
4. Uttarakhand: Dengue outbreak sweeps through Dehradun, prompting urgent action
5. Taraba govt denies outbreak of Anthrax
6. Dominicana atraviesa brote epidémico de dengue
7. Calgary daycare E.coli outbreak continues to add numbers – Calgary
8. Alberta Premier sends thoughts and prayers to E.coli patients one week after outbreak
9. Parent Initiates Class-Action Lawsuit Following E.Coli Outbreak at Calgary Daycares
10. Dialysis machines brought in to treat children in Calgary daycare E.coli outbreak
11. E.coli cases continue to rise after outbreak from Calgary daycares
12. 96 cases linked to Calgary daycare E.coli outbreak: AHS update – Calgary
13. Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital – Winnipeg Free Press
14. Calgary daycares hit by E.coli outbreak could be shut down for another week – Canada News
15. Officials say some patients showing severe symptoms in Calgary daycare outbreak – Canada News
16. Officials Say Some Patients Showing Severe Symptoms in Calgary Daycare Outbreak
17. Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital – Canada News
18. Bangladesh hit by worst dengue outbreak on record, says WHO
19. Legionnaire disease outbreak in southeast Poland on decline with only 1 new case reported
20. WHO: Bangladesh hit by worst dengue outbreak on record
The rest of the headlines do not relate to a disease outbreak and have been deleted.
ChatGPT seems to have filtered a number of relevant headlines out. Let's try the inverse – let's translate the headlines first:
PaLM:
Namibia Conducts Crimean Congo Haemorrhagic After-Action Review
Hanoi: The number of dengue fever cases in Dong Da and Cau Giay skyrocketed
Hanoi: The number of dengue fever cases in Dong Da and Cau Giay skyrocketed
Patras: The demolition of the two earthquake-damaged buildings of the student residence (pics) is completed
Hanoi records more than 1,000 dengue fever cases in 1 week
Calgary daycare E.coli outbreak continues to add numbers – Calgary
Alberta Premier sends thoughts and prayers to E.coli patients one week after outbreak
A mother-daughter battle broke out!? The birthday present caused a big uproar!! And then… <Tantrum feelings> (September 6, 2023) | Woman Excite (1/2)
Uttarakhand: Dengue outbreak sweeps through Dehradun, prompting urgent action
Viral Video: An elephant suddenly attacked the bus, and the passengers panicked!
Jo 24: The first Egyptian civilian plane lands in Sudan since the outbreak of the crisis
Hanoi adds more than 1,000 dengue fever cases in a week, the epidemic is still complicated
Namibia Conducts Crimean Congo Haemorrhagic After-Action Review
Ottawa ready to help as Alberta daycare E.coli outbreak grows
Our two neighboring countries, the border suddenly broke out in conflict _ Military Channel _ China.com
Parent Initiates Class-Action Lawsuit Following E.Coli Outbreak at Calgary Daycares
Dialysis machines brought in to treat children in Calgary daycare E.coli outbreak
E.coli cases continue to rise after outbreak from Calgary daycares
Taraba govt denies outbreak of Anthrax
Dominicana atraviesa brote epidémico de dengue
The most dangerous volcanoes in the world: Top 10
The burning of the Qur'an: Violent riots broke out after the burning of the Qur'an in the country
Let the second chase three! Chen Meng and Wang Manyu上演神剧情, knocked out the Japanese team, roared in desperation
A fire broke out in an internet service shop in Imbaba, Giza
Alberta premier asks ministers for full assessment of E.coli outbreak in Calgary – Winnipeg Free Press
Hong Kong Siyi Chamber of Commerce Chen Nanchang Memorial College Potential Outbreak – Ming School Network – Hong Kong Kindergarten, Primary School, Secondary School and International School Information Platform
The diseased clothes became oranges
A fire broke out in a residential apartment in the East (pictures)
96 cases linked to Calgary daycare E.coli outbreak: AHS update – Calgary
Pd, Orlando on the 31 Ligurian leaders who left the party: Delayed exits, in the past we remained
Big outbreak! The strongest consecutive 8漲停,无人驾驶板块异动拉升, CRO板块重回下降通道 – Stocks – Financial Circle
If a cross-strait conflict breaks out, the US military will run out of ammunition within a week? _ Military Channel _ China.com
96 lab-confirmed cases linked to E.coli at Calgary daycares, 22 kids in hospital: AHS
Italy: Supervolcano threatens millions of people in southern Italy – Expert with assessment
False claims of an Ebola outbreak at the Burning Man concert
The most serious dengue fever outbreak in history
"Fugitive Love" spoiler: Eugenia's wild outburst
Phlegräische Felder: Europe's supervolcano is threatening to erupt
Alberta premier asks ministers for full assessment of E.coli outbreak in Calgary
Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital – Winnipeg Free Press
Calgary daycares hit by E.coli outbreak could be shut down for another week – Canada News
Calgary daycares hit by E.coli outbreak could be shut down for another week – Canada News
A fire broke out in a shop on Francisco Villarreal Boulevard
This is what the student residences in old Nicosia will look like (pics)
Officials say some patients showing severe symptoms in Calgary daycare outbreak – Canada News
Officials say some patients showing severe symptoms in Calgary daycare outbreak – Canada News
Officials say some patients showing severe symptoms in Calgary daycare outbreak – Canada News
Officials Say Some Patients Showing Severe Symptoms in Calgary Daycare Outbreak
A young man under a psychotic outbreak threatened and took his parents hostage in Cordoba
Burning Man 2023 FEMA and Ebola outbreak rumors debunked
Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital – Canada News
Military policeman shot dead by a man in an outbreak in Itirapina
tayyar.org – Hot air masses from Egypt… and a noticeable rise in temperatures!
Officials say some patients showing severe symptoms in Calgary daycare outbreak
AMD – Bullish consolidation?
Fire broke out in an air conditioning system shop
A young man was arrested for stabbing another to death at a wedding in Assiut
Hanoi: Dengue fever epidemic is still complicated
E.coli outbreak sends at least 50 children to hospital in Calgary
A huge fire broke out in a 5-storey building in the 10th district of 6 October
17 more people were identified with corona in the country
This week, the defense and military industry rose by 4.3%, the media industry fell by more than 6%, the Huawei industry chain broke out, and photoresist, photoresist, satellite communications and other题材全线崛起
Italy: Supervolcano could destroy Naples – Volcanologist gives assessment
Bangladesh hit by worst dengue outbreak on record, says WHO
Legionnaire's disease outbreak in southeast Poland on the decline with only 1 new case reported
Rumors of Ebola outbreak at Burning Man Festival – here's why they're false
University of Patras: More than 100 rooms ready by the start of the new year
How to prevent dengue fever when living in an area with an outbreak
Video: Shooting and shelling in Ein el-Helweh camp – Lebanese Forces Official Website
Alberta health officials report 128 lab-confirmed cases of E.coli linked to outbreak at daycares
3 hours to catch "3 RSV children"! Major symptoms exposed Physician: Abnormal outbreak this summer | Life | Sanli News Network SETN.COM
Putin received three good news in a row: Biden and Trump bombarded each other! Internal strife broke out in Ukraine _ Zelensky _ serious _ United States
A cigarette butt caused a fire in an apartment and injured its owner in Sohag
WHO: Bangladesh hit by worst dengue outbreak on record
The search for the source of the Legionella outbreak in Caceres has not yielded results at the moment
ChatGPT:
Namibia Conducts Crimean Congo Haemorrhagic After-Action Review
Hanoi: Dengue Fever Cases Soar in Dong Da and Cau Giay
Hanoi: Dengue Fever Cases Soar in Dong Da and Cau Giay
Patras: Demolition of Two Earthquake-Damaged Student Dormitories Completed (pics)
Hanoi Records Over 1,000 Dengue Fever Cases in One Week
Calgary Daycare E.coli Outbreak Continues to Grow
Alberta Premier Sends Thoughts and Prayers to E.coli Patients One Week After Outbreak
Mother-Daughter Battle Erupts!? Birthday Gift Disagreement Leads to Turmoil and… (September 6, 2023) | Woman Excite (1/2)
Uttarakhand: Dengue Outbreak Sweeps Through Dehradun, Prompting Urgent Action
Viral Video: Elephant Causes Panic on Bus, Passengers in Distress!
JO 24: First Egyptian Civilian Plane Lands in Sudan Since the Crisis Began
Hanoi Records Over 1,000 Dengue Fever Cases in One Week, Complex Situation Persists
Namibia Conducts Crimean Congo Haemorrhagic After-Action Review
Ottawa Ready to Help as Alberta Daycare E.coli Outbreak Grows
Sudden Border Conflict Erupts Between Our Two Neighbor Countries
Parent Initiates Class-Action Lawsuit Following E.Coli Outbreak at Calgary Daycares
Dialysis Machines Brought in to Treat Children in Calgary Daycare E.coli Outbreak
E.coli Cases Continue to Rise After Outbreak From Calgary Daycares
Taraba Government Denies Outbreak of Anthrax
Dominican Republic Experiences Epidemic Dengue Outbreak
The World's Most Dangerous Volcanoes: Top 10
Quran Burning: Rioting Erupts After Quran Burning in the Country
Let the Drama Begin: Chen Meng and Wang Manyu Stage an Epic Battle, Eliminating the Japanese Pair, Explosive Situations in Desperation
Massive Fire Breaks Out in Internet Service Shop in Giza
Alberta Premier Asks Ministers for Full Assessment of E.coli Outbreak in Calgary – Winnipeg Free Press
Hong Kong Four Districts Chamber of Commerce Chen Nanchang Memorial School Experiences a Surge in Potential – Ming School Network – Information Platform for Kindergartens, Primary Schools, Secondary Schools, and International Schools in Hong Kong
Rogale Sukna Thale Suntala
Massive Fire Erupts Inside Residential Building in the Eastern Province (Photos)
96 Cases Linked to Calgary Daycare E.coli Outbreak: AHS Update – Calgary
PD, Orlando on the 31 Ligurian Leaders Who Left the Party: Delayed Explosive Exits, We Were Left Behind in the Past
Massive Outbreak! The Most Bulls Pull Eight Limit Ups in a Row, Unmanned Driving Sector Surges, CRO Sector Returns to the Downward Channel – Stocks – Finance World
If a Taiwan Strait Conflict Erupts, Will the U.S. Run Out of Ammunition Within a Week?
96 Lab-Confirmed Cases Linked to E.coli at Calgary Daycares, 22 Kids in Hospital: AHS
Italy: Supervolcano Threatens Millions in Southern Italy – Expert Assessment
False Claims of an Ebola Outbreak at the Burning Man Concert
The Most Severe Dengue Fever Outbreak in History
"Runaway Love" Spoiler: Eugenia's Wild Outburst
Phlegraean Fields: Europe's Supervolcano Threatens to Erupt
Alberta Premier Asks Ministers for Full Assessment of E.coli Outbreak in Calgary
Calgary E.coli Outbreak Connected to Daycare Sites Sends Dozens of Kids to Hospital – Winnipeg Free Press
Calgary Daycares Hit by E.coli Outbreak Could Be Shut Down for Another Week – Canada News
Calgary Daycares Hit by E.coli Outbreak Could Be Shut Down for Another Week – Canada News
Conato de Incendio en Local de Bulevar Francisco Villarreal
This Is How Student Dormitories in Old Nicosia Will Look (Pics)
Officials Say Some Patients Showing Severe Symptoms in Calgary Daycare Outbreak – Canada News
Officials Say Some Patients Showing Severe Symptoms in Calgary Daycare Outbreak – Canada News
Officials Say Some Patients Showing Severe Symptoms in Calgary Daycare Outbreak – Canada News
Officials Say Some Patients Showing Severe Symptoms in Calgary Daycare Outbreak
A Young Man Under Psychotic Outburst Threatens and Takes Parents Hostage in Cordoba
Burning Man 2023 FEMA and Ebola Outbreak Rumors Debunked
Calgary E.coli Outbreak Connected to Daycare Sites Sends Dozens of Kids to Hospital – Canada News
Military Policeman Shot by Man in Crisis in Itirapina Dies
Tayyar.org – Hot Air Masses from Egypt… and Noticeable Temperature Rise!
Officials Say Some Patients Showing Severe Symptoms in Calgary Daycare Outbreak
AMD – Bullish Consolidation?
Conato de Incendio en Local de Sistemas de Aire Acondicionado
Arrest of a Young Man Who Killed Another with a Knife at a Wedding Party in Assiut
Hanoi: Dengue Fever Outbreak Continues to Develop Complicatedly
E.coli Outbreak Sends at Least 50 Children to Hospital in Calgary
Massive Fire Breaks Out in a 5-Storey Building in the Tenth District of 6th of October City
17 More Confirmed Coronavirus Cases in the Country
Defense and Military Industry Soars 4.3% This Week, Media Industry Plummets Over 6%, Huawei Industry Chain Explodes, Photoresist, Satellite Communications, and Other Themes Rise Across the Board
Italy: Supervolcano Could Destroy Naples – Volcanologist Provides Assessment
Bangladesh Hit by Worst Dengue Outbreak on Record, Says WHO
Legionnaire Disease Outbreak in Southeast Poland on Decline, with Only 1 New Case Reported
Rumors of Ebola Outbreak at Burning Man Festival – Here's Why They're False
University of Patras: Over 100 Rooms Ready by the Start of the New Year
How to Prevent Dengue Fever When Living in an Outbreak Area
Video: Gunfire and Shelling Heard in Ain al-Hilweh Camp – Lebanese Forces Official Website
Alberta Health Officials Report 128 Lab-Confirmed Cases of E.coli Linked to Outbreak at Daycares
3-Hour Capture of "3 RSV Children"! Major Symptoms Revealed, Doctor: Unusual Outbreak This Summer | Life | Sanli News Network SETN.COM
Putin Receives Three Pieces of Good News in a Row: Biden and Trump Exchange Fire, Internal Turmoil Erupts in Ukraine – Liangski – Serious – United States
Cigarette Butt Ignites Fire in an Apartment, Injuring the Owner in Sohag
WHO: Bangladesh Hit by Worst Dengue Outbreak on Record
Search for the Source of the Caceres Legionella Outbreak Yields No Results for Now
Now we'll use the following prompt to perform filtering. For PaLM we'll hand it the translations it generated above and do the same for ChatGPT:
For each of the news headlines below, decide whether it mentions a disease outbreak. If it does not relate to a disease outbreak, delete it.
PaLM:
Namibia Conducts Crimean Congo Haemorrhagic After-Action Review
Hanoi: The number of dengue fever cases in Dong Da and Cau Giay skyrocketed
Hanoi: The number of dengue fever cases in Dong Da and Cau Giay skyrocketed
Hanoi records more than 1,000 dengue fever cases in 1 week
Calgary daycare E.coli outbreak continues to add numbers – Calgary
Alberta Premier sends thoughts and prayers to E.coli patients one week after outbreak
Uttarakhand: Dengue outbreak sweeps through Dehradun, prompting urgent action
Hanoi adds more than 1,000 dengue fever cases in a week, the epidemic is still complicated
Ottawa ready to help as Alberta daycare E.coli outbreak grows
Parent Initiates Class-Action Lawsuit Following E.Coli Outbreak at Calgary Daycares
Dialysis machines brought in to treat children in Calgary daycare E.coli outbreak
E.coli cases continue to rise after outbreak from Calgary daycares
Taraba govt denies outbreak of Anthrax
Dominicana atraviesa brote epidémico de dengue
The most dangerous volcanoes in the world: Top 10
The burning of the Qur'an: Violent riots broke out after the burning of the Qur'an in the country
96 cases linked to Calgary daycare E.coli outbreak: AHS update – Calgary
Alberta premier asks ministers for full assessment of E.coli outbreak in Calgary – Winnipeg Free Press
The diseased clothes became oranges
96 lab-confirmed cases linked to E.coli at Calgary daycares, 22 kids in hospital: AHS
Italy: Supervolcano threatens millions of people in southern Italy – Expert with assessment
False claims of an Ebola outbreak at the Burning Man concert
The most serious dengue fever outbreak in history
Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital – Winnipeg Free Press
Calgary daycares hit by E.coli outbreak could be shut down for another week – Canada News
Calgary daycares hit by E.coli outbreak could be shut down for another week – Canada News
Officials say some patients showing severe symptoms in Calgary daycare outbreak – Canada News
Officials say some patients showing severe symptoms in Calgary daycare outbreak – Canada News
Officials say some patients showing severe symptoms in Calgary daycare outbreak – Canada News
Officials Say Some Patients Showing Severe Symptoms in Calgary Daycare Outbreak
Calgary E.coli outbreak connected to daycare sites sends dozens of kids to hospital – Canada News
Military policeman shot dead by a man in an outbreak in Itirapina
Hanoi: Dengue fever epidemic is still complicated
E.coli outbreak sends at least 50 children to hospital in Calgary
17 more people were identified with corona in the country
WHO: Bangladesh hit by worst dengue outbreak on record
Legionnaire's disease outbreak in southeast Poland on the decline with only 1 new case reported
Rumors of Ebola outbreak at Burning Man Festival – here's why they're false
Alberta health officials report 128 lab-confirmed cases of E.coli linked to outbreak at daycares
3 hours to catch "3 RSV children"! Major symptoms exposed Physician: Abnormal outbreak this summer | Life | Sanli News Network SETN.COM
ChatGPT:
Here are the headlines that mention a disease outbreak:
1. Hanoi: Dengue Fever Cases Soar in Dong Da and Cau Giay
2. Hanoi: Dengue Fever Cases Soar in Dong Da and Cau Giay
3. Hanoi Records Over 1,000 Dengue Fever Cases in One Week
4. Calgary Daycare E.coli Outbreak Continues to Grow
5. Alberta Premier Sends Thoughts and Prayers to E.coli Patients One Week After Outbreak
6. Uttarakhand: Dengue Outbreak Sweeps Through Dehradun, Prompting Urgent Action
7. Dominican Republic Experiences Epidemic Dengue Outbreak
8. E.coli Cases Continue to Rise After Outbreak From Calgary Daycares
9. WHO: Bangladesh Hit by Worst Dengue Outbreak on Record
10. Legionnaire Disease Outbreak in Southeast Poland on Decline, with Only 1 New Case Reported
11. How to Prevent Dengue Fever When Living in an Outbreak Area
12. WHO: Bangladesh Hit by Worst Dengue Outbreak on Record
13. Search for the Source of the Caceres Legionella Outbreak Yields No Results for Now
These headlines relate to disease outbreaks or epidemics. The rest of the headlines do not mention a disease outbreak.
Interestingly, reversing the process (translation->filtering vs filtering->translation) does not improve the ChatGPT results, whereas it yields an enormous improvement in PaLM's results. However, for PaLM the substantial increase in recall also yields a much higher false positive rate.
Now let's try our final summarization prompt using just the outputs above:
PaLM:
**Namibia**
Namibia has conducted an After-Action Review (AAR) for Crimean Congo Hemorrhagic Fever (CCHF).
**Vietnam**
Hanoi, the capital of Vietnam, has seen a recent surge in dengue fever cases, particularly in the districts of Dong Da and Cau Giay. In just one week, the city recorded more than 1,000 new cases, bringing the total number of cases in the city to over 10,000. The dengue fever epidemic in Hanoi is considered to be "complicated" and is causing concern among health officials.
**Canada**
In Calgary, Canada, an E.coli outbreak linked to several daycare centers continues to grow, with the number of confirmed cases rising to 96. The outbreak has resulted in dozens of children being hospitalized, and some patients are showing severe symptoms. The affected daycare centers have been shut down for a week and could remain closed for another week. The Alberta Premier has asked for a full assessment of the outbreak, and health officials are working to contain the spread of the infection.
**India**
In Dehradun, India, an outbreak of dengue fever has prompted urgent action from health officials. The city has seen a significant increase in cases, and measures are being taken to control the spread of the disease.
**Dominican Republic**
The Dominican Republic is currently experiencing an epidemic outbreak of dengue fever, with a significant increase in cases reported across the country.
**Italy**
In southern Italy, experts have warned of the potential threat posed by a supervolcano, which could impact millions of people in the region.
**Poland**
In southeast Poland, an outbreak of Legionnaire's disease has been on the decline, with only one new case reported recently.
ChatGPT:
In Hanoi, Vietnam, there is a concerning surge in Dengue Fever cases, particularly in the Dong Da and Cau Giay districts. The outbreak has been severe, with over 1,000 cases recorded in just one week. In another part of the world, the Dominican Republic is also grappling with an epidemic Dengue outbreak. Meanwhile, in Bangladesh, the situation is dire, as it faces its worst Dengue outbreak on record, according to the World Health Organization (WHO).
Moving to Canada, Calgary is dealing with a growing E.coli outbreak in daycare facilities. The outbreak has prompted Alberta's Premier to express condolences to the affected patients. In the same province, E.coli cases continue to rise.
In India, the city of Dehradun in Uttarakhand is witnessing a sweeping Dengue outbreak, necessitating urgent action. In Southeast Poland, a Legionnaire Disease outbreak appears to be on the decline, with only one new case reported.
Lastly, there's an ongoing investigation into the source of the Legionella outbreak in Caceres, Spain, with no conclusive results thus far. In the midst of these outbreaks, there's a proactive effort to educate the public on preventing Dengue Fever when living in affected areas.
Looking more closely at the results above, the results from our multi-step single-pass run (filter, translate and summarize all at once) actually yields better or at least similar results to our three-step workflow and costs 1/3 of the amount.