Creating A Daily Disease Summarizer Using The DOC 2.0 API + PaLM/ChatGPT

Yesterday we explored different workflows for using the DOC 2.0 API to track global disease outbreaks using LLMs to summarize the resulting headlines. One challenge of that example is that we used the generic term "outbreak" as our search criteria, which also returns "outbreak of violence", "outbreak of inflation", etc. Let's try narrowing our search to just a specific disease like dengue and summarize the resulting headlines through PaLM and ChatGPT.

The headlines are a mixture of languages, with key details in PaLM's supported languages of English, Bengali and Hindi. While additional detail is recorded in Malayalam and Tamil which are not yet supported by PaLM, the core gist of the country-level case information can be recovered only from PaLM's supported languages.

The end result is that ChatGPT provides vastly more comprehensive and accurate summarization of the headlines, with PaLM missing most of the detail and consistently hallucinating details including precise case counts for Bolivia, confidently stating that there were 1,165 cases, 1,130 cases, or 1,167 cases, depending on run, whereas the source text mentions Bolivia only once – in the context of a "Latin America & Caribbean Weekly Situation Update – Bolivia". Switching to the newly announced PaLM 32K model, the Bolivian hallucination disappears, but it continues to miss much of the detail in the text.

Let's run a search for "dengue" over the last 24 hours using the DOC 2.0 API and use our combination prompt to summarize.

time curl \
-X POST \
-H "Authorization: Bearer $(gcloud auth print-access-token)" \
-H "Content-Type: application/json" \
https://us-central1-aiplatform.googleapis.com/v1/projects/[YOURPROJECTID]/locations/us-central1/publishers/google/models/text-bison:predict -d \
$'{
  "instances": [
    { "prompt": "Summarize the following list of news article headlines that are written in different languages into a detailed summary in English, making sure to incorporate all of the detail from the different headlines in a single summary. Ignore headlines that do not relate to dengue fever. Break the summary down by country. HEADLINES: 比断骨还痛 , 已致多人死亡 ! 登革热近期高发
Dengue fever n karnataka | டெங்கு காய்ச்சல் பரவலை தடுக்க முன்எச்சரிக்கை நடவடிக்கை ; சித்தராமையா உத்தரவு
उत्तराखंड में डेंगू का बरपा कहर ... हजारों लोग चपेट में,रोकथाम के लिए ऐक्शन मोड में सरकार,अभियान शुरू
Dengue cases surge in Uttar Pradesh,patient count exceeds 200 in Kanpur
Dengue Fever: What Exactly Happens Inside Our Body When Infected With Virus ? Is Second Time Dengue Infection More Dangerous ? 
ঢাকার বাইরে ডেঙ্গুর দাপট
Dengue Attack: डेंगू की रोकथाम के लिए देहरादून में चार दिन चलेगा महाअभियान,हॉट स्पॉट इलाकों से होगी शुरुआत - Dehradun News Campaign To Prevent Dengue Will Run For Four Days Starting From Hot Spot Areas
Dengue cases in UP Kanpur cross 200 mark
ডেঙ্গুতে একদিনে ১১ জনের মৃত্যু,২৯৪৪ রোগী হাসপাতালে ভর্তি
خیبر پختونخوا ؛ ڈینگی کیسز تیزی سے بڑھنے لگے ، 5 اضلاع ہائی رِسک قرار
Dengue Cases In UP Kanpur Cross 200 Mark
health department alert regarding dengue in chatra system tight srn | चतरा में डेंगू को लेकर स्वास्थ्य विभाग अलर्ट,व्यवस्था चुस्त - दुरुस्त
এ বছর ডেঙ্গু আক্রান্তের সংখ্যা দেড় লাখ ছাড়াল
Innovative approaches to preventing dengue
Lucknow Dengue Cases: लखनऊ में डेंगू केस बढ़े लक्षण दिखने के बाद तत्काल डॉक्टरों से संपर्क करने की अपील - Lucknow Dengue cases increase appeal to contact doctors immediately after symptoms appear
Chandigarh: 27 dengue cases surface in first 11 days of Sept
Major four - day anti - dengue campaign to be conducted in Dehradun district
Dengue Treatment: डेंगू से जल्द होना चाहते हैं रिकवर,तो अपनाएं ये आसान से टिप्स - Follow these tips to recover from Dengue at home soon
Dengue: डेंगू के दो मरीज मिले तो पूरे गांव की होगी जांच,टीमें गठित,मुख्य चिकित्साधिकारियों को दिए निर्देश - Uttar Pradesh Government Prepared Plan To Control The Dengue.
Dengue stings: figure reaches 144 with 5 new cases in Sonipat | डस रहा डेंगू का डंक: सोनीपत में 5 नए केस के साथ 144 पहुंचा आकड़ा
Uttarakhand reports over 1,100 cases of dengue this year
Jammu News: डेंगू के 67 मामले,जम्मू से 50 - Dengue,Cases,Health Department
52 new cases take total number of active dengue cases to 267
ডেঙ্গুতে ১১ জনের মৃত্যু,হাসপাতালে ভর্তি
Guadeloupe / Martinique: les cas de dengue se multiplient
Chandigarh News: शहर में डेंगू के अब तक 79 मामले,एडवाइजरी जारी - 79 Cases Of Dengue In The City So Far,Advisory Issued
டெங்கு காய்ச்சல் பரவுதல்: தலைமை செயலாளர் தலைமையில் இன்று மாலை அனைத்து துறை அதிகாரிகள் கூட்டம்
Dengue menace at MCH staff quarters affects 2
Dengue Fever: After Eight New Cases On Monday,Dengue Tally In Gzb Stands At 422 |
नॉएडा में बढ़ा डेंगू का प्रकोप ! एक दिन में आये इतने केस की सुनकर उड़ जाएंगे होश
পেঁপে পাতার রস খেলে কি আসলেই প্লাটিলেট বাড়ে
ডেঙ্গুর চেয়ে ভয়ঙ্কর এই সরকার: মির্জা ফখরুল
Viral Infections: Bed Crunch At Mgmmch As Cases Surge |
Dengue cases cross 1.5 lakh this year
Bangladesh worst dengue outbreak hits the poor hard
পেঁপে পাতার রস খেলে কি আসলেই প্লাটিলেট বাড়ে
Govt failure to control dengue lambasted
Dengue cases up,Bengaluru faces shortage of platelets | Bengaluru News
డెంగీ .. పంజా
Jadavpur University final - year MTech student fourth to die of dengue in Kolkata in a week | Kolkata News
TN Health Department On Alert After 4 - year - old Chennai Boy Dies Of Dengue
ডেঙ্গুতে আরও ১১ জনের মৃত্যু,হাসপাতালে নতুন ভর্তি ২৯৪৪
দেশের মানুষকে বাঁচাতে কিছুই করেনি সরকার: রিজভী
After four - year - old boy death,Chennai corporation speeds up anti - dengue measures | Chennai News
Moustique tigre : Opération de démoustication après un cas de dengue près de Nantes
ডেঙ্গু প্রতিরোধে সচেতনতা বাড়াতে বিএনপির তিন দিনের কর্মসূচি
কমিশন খাওয়ার জন্যই এয়ারবাস কিনতে চায় সরকার: ফখরুল
একদিনে ডেঙ্গুতে আরও ১১ জনের মৃত্যু,হাসপাতালে ২৯৪৪
কমিশন খাওয়ার জন্যই এয়ারবাস কিনতে চায় সরকার: মির্জা ফখরুল
সরকার চিকিৎসা দিতে পারছে না,অথচ কমিশনের উদ্দেশ্যে এয়ারবাস কিনছে: মির্জা ফখরুল
CM asks people to be cautious about mosquito bite
Prakash Raj -  सनातन धर्म डेंगू की तरह है - प्रकाश राज के बयान से मचा बवाल Prakash Raj -  Sanatan Dharma is like dengue - Prakash Raj statement created uproar at Karnataka
sadhvi pragya singh thakur reply on sanatan dharma oppose - वह कुष्ट और एड्स का सुख भोगें ; सनातन विरोध पर साध्वी प्रज्ञा का  श्राप,प्रकाश राज पर भी बरसीं,मध्य प्रदेश न्यूज
डेङ्गु र स्क्रब टाइफसका बिरामी बढे
ডেঙ্গু প্রতিরোধে মাঠে নামছে থিংক গ্রুপ,সঙ্গে আছে  মশার মেশিন  
Fill ditches dug for works in 24 hours or pay expenses and penalty,warns mayor
  I.N.D.I.A.Alliance Formed to Fight Santana Dharma: Another DMK Minister Stokes Controversy | WATCH
Latin America & The Caribbean Weekly Situation Update ( As of 11 September 2023 ) - Bolivia ( Plurinational State of ) 
নির্বাচিত সরকার থাকলে ডেঙ্গুতে এত প্রাণহানি হতো না: ইশরাক হোসেন
అమ్మో జ్వరాలు .. 
নির্বাচিত সরকার ও জনপ্রতিনিধি থাকলে ডেঙ্গুতে এত প্রাণহানি হতো না: ইশরাক
  Hinduism Threat To Entire World: DMK MP A Raja Sparks Controversy ; Says India Responsible For Global  Caste  Disease
Tony Leachon steps down as DOH special adviser
एक्टर प्रकाश राज कुष्ठ और एड्स का सुख भोगे,सनातन का विरोध करने पर BJP सांसद प्रज्ञा सिंह ठाकुर ने दिया श्राप
Tracking Dengue: 8 New Cases Found In Indore,Total Stands At 113
डेङ्गुका सङ्क्रमित बढ्दै
सनातन धर्माविरुद्ध बोलणाऱ्यांची जीभ खेचेन,डोळे ...; केंद्रीय मंत्र्यांचा तोल सुटला
Leachon resigns as DOH adviser
होटलमा जुवातास खेलिरहेका तीन जना पक्राउ | News from Nepal
വീണ്ടും എലിപ്പനി,ഡെങ്കിപ്പനി ഭീഷണി ; ജാഗ്രതാനിര്‍ദേശവുമായി ആരോഗ്യവകുപ്പ്‌
கேரளாவில் நிபா வைரஸ் பாதித்து 2 பேர் பலி ? பொதுமக்கள் எச்சரிக்கையுடன் இருக்க சுகாதாரத்துறை அறிவுறுத்தல்
Read all Latest Updates on and about Department of Health
Read all Latest Updates on and about சுகாதாரத்துறை
Read all Latest Updates on and about Nipah virus
Read all Latest Updates on and about நிபா வைரஸ்
"}
  ],
  "parameters": {
    "temperature": 0.2,
    "maxOutputTokens": 2048,
    "topK": 40,
    "topP": 0.95
  }
}' > O; cat O | jq -r .predictions[0].content

PaLM First Run:

**India**
– In Uttar Pradesh, the number of dengue cases in Kanpur has crossed 200.
– The Uttarakhand government has launched a four-day campaign to prevent dengue in Dehradun.
– The number of dengue cases in Delhi has reached 1,100 this year.
– The West Bengal government has been lambasted for its failure to control dengue.
– In Karnataka, a four-year-old boy has died of dengue.
– The Tamil Nadu Health Department is on alert after a four-year-old boy died of dengue in Chennai.
– The death toll from dengue in Bangladesh has risen to 11.
– The BNP has announced a three-day program to raise awareness about dengue prevention.
– The government has been accused of failing to provide adequate medical care for dengue patients.
– Prakash Raj, a well-known actor, has compared Sanatana Dharma to dengue.
– The DMK MP, A Raja, has said that Hinduism is a threat to the entire world.
– The Union Minister, Pragya Singh Thakur, has cursed those who oppose Sanatana Dharma.

**Guadeloupe/Martinique**
– Dengue cases are increasing in Guadeloupe and Martinique.

**Latin America & The Caribbean**
– Bolivia has reported 1,165 cases of dengue this year.

**Nepal**
– Three people have been arrested for gambling in a hotel in Nepal.

PaLM Second Run:

**India**
– In Uttar Pradesh, the number of dengue cases in Kanpur has crossed 200.
– The Uttarakhand government has launched a four-day campaign to prevent dengue in Dehradun.
– The number of dengue cases in Delhi has reached 1,100 this year.
– The West Bengal government has been lambasted for its failure to control dengue.
– In Karnataka, a four-year-old boy has died of dengue.
– The Tamil Nadu Health Department is on alert after a four-year-old boy died of dengue in Chennai.
– The death toll from dengue in Bangladesh has reached 11.
– The BNP has announced a three-day program to raise awareness about dengue prevention.
– The government has been accused of failing to provide adequate medical care for dengue patients.
– Prakash Raj, a well-known actor, has compared Sanatana Dharma to dengue, sparking a controversy.
– The DMK MP, A Raja, has said that Hinduism is a threat to the entire world and that India is responsible for the global caste disease.
– The Union Minister, Pragya Singh Thakur, has cursed those who oppose Sanatana Dharma, saying that they should suffer from leprosy and AIDS.
– The number of dengue cases in Indore has reached 113.
– The death toll from dengue in Nepal has reached 11.

**Guadeloupe/Martinique**
– Dengue cases are increasing in Guadeloupe and Martinique.

**Latin America & The Caribbean**
– Bolivia has reported 1,130 dengue cases this year.

PaLM Third Run:

**India**
– In Uttar Pradesh, the number of dengue cases in Kanpur has crossed 200.
– The Uttarakhand government has launched a four-day campaign to prevent dengue in Dehradun.
– The number of dengue cases in Delhi has reached 1,100 this year.
– The West Bengal government has been lambasted for its failure to control dengue.
– In Karnataka, a four-year-old boy has died of dengue.
– The Tamil Nadu Health Department is on alert after a four-year-old boy died of dengue in Chennai.
– The death toll from dengue in Bangladesh has reached 11.
– The BNP has announced a three-day program to raise awareness about dengue prevention.
– The government has been accused of failing to provide adequate medical care for dengue patients.
– Prakash Raj, a well-known actor, has compared Sanatana Dharma to dengue, sparking a controversy.
– The DMK MP, A Raja, has said that Hinduism is a threat to the entire world and that India is responsible for the global caste disease.

**Guadeloupe/Martinique**
– Dengue cases are increasing in Guadeloupe and Martinique.

**Latin America & The Caribbean**
– Bolivia has reported 1,167 cases of dengue this year.

**Nepal**
– Three people have been arrested for gambling in a hotel in Nepal.

**United States**
– Tony Leachon has resigned as special adviser to the DOH.

ChatGPT First Run:

Dengue fever outbreaks have been reported in several regions around the world:

**China**: 比断骨还痛,已致多人死亡!登革热近期高发 (More painful than bone fractures, has already caused multiple deaths! Recent surge in dengue fever)

**India – Karnataka**: Dengue fever cases have surged in Karnataka, with a warning issued to take preventive measures. டெங்கு காய்ச்சல் பரவலை தடுக்க முன்எச்சரிக்கை நடவடிக்கை; சித்தராமையா உத்தரவு (Preventive action to control dengue outbreak, heightened alert issued)

**India – Uttar Pradesh**: Dengue cases have surged in Uttar Pradesh, with over 200 cases reported in Kanpur. उत्तराखंड में डेंगू का बरपा कहर … हजारों लोग चपेट में, रोकथाम के लिए ऐक्शन मोड में सरकार, अभियान शुरू (Dengue outbreak in Uttarakhand, thousands affected, government initiates action for prevention)

**Bangladesh**: Dengue fever has affected a significant number of people, with a rising death toll. ডেঙ্গুতে একদিনে ১১ জনের মৃত্যু, ২৯৪৪ রোগী হাসপাতালে ভর্তি (11 deaths in one day due to dengue, 2944 patients hospitalized)

**Pakistan**: Dengue cases are increasing rapidly in several high-risk districts. خیبر پختونخوا ؛ ڈینگی کیسز تیزی سے بڑھنے لگے ، 5 اضلاع ہائی رِسک قرار (Khyber Pakhtunkhwa; rapid increase in dengue cases, 5 districts declared high-risk)

**India – Dehradun**: A four-day campaign has been initiated in Dehradun to prevent dengue, starting from hot spot areas. Dengue Attack: डेंगू की रोकथाम के लिए देहरादून में चार दिन चलेगा महाअभियान, हॉट स्पॉट इलाकों से होगी शुरुआत (Four-day campaign in Dehradun to control dengue, starting from hot spots)

**India – Lucknow**: Dengue cases have increased in Lucknow, and an appeal has been made to contact doctors immediately after symptoms appear. Lucknow Dengue Cases: लखनऊ में डेंगू केस बढ़े लक्षण दिखने के बाद तत्काल डॉक्टरों से संपर्क करने की अपील (Increase in dengue cases in Lucknow, appeal to contact doctors)

**India – Chandigarh**: Chandigarh has reported 27 dengue cases in the first 11 days of September. Chandigarh News: शहर में डेंगू के अब तक 79 मामले, एडवाइजरी जारी (79 dengue cases in the city so far, advisory issued)

**India – Indore**: Eight new dengue cases were found in Indore, bringing the total to 113. Tracking Dengue: 8 New Cases Found In Indore, Total Stands At 113

**Guadeloupe/Martinique**: Dengue cases are multiplying in these Caribbean regions. Guadeloupe/Martinique: les cas de dengue se multiplient

**Nepal**: Three individuals playing in a hotel are diagnosed with dengue. होटलमा जुवातास खेलिरहेका तीन जना पक्राउ (Three individuals playing at a hotel)

**Sri Lanka**: Dengue cases are on the rise, with an alert issued by the health department. ඡෝක් සිකුරා ; ඩෙංගිවරු ආචාර්යේ මාර්ගය කළේ කුමුද (Dengue Prevention Awareness Program)

**France – Nantes**: A dengue case near Nantes led to a mosquito eradication operation. Moustique tigre : Opération de démoustication après un cas de dengue près de Nantes

**Latin America & The Caribbean**: Dengue cases are reported in Bolivia (Plurinational State of) as part of a weekly situation update.

**Global**: There is controversy in India related to statements made by political figures regarding dengue and religion, with Prakash Raj and Sadhvi Pragya Singh Thakur making headlines. Hinduism Threat To Entire World: DMK MP A Raja Sparks Controversy; Says India Responsible For Global Caste Disease

**Philippines**: Tony Leachon resigned from his position as DOH special adviser.

These headlines collectively depict a widespread and growing concern over dengue fever outbreaks in various regions, with governments and health departments taking measures to control the spread of the disease. Additionally, there is political controversy and awareness campaigns related to dengue in some areas.

ChatGPT Second Run

Dengue fever outbreaks have been reported in several countries:

**China:** Dengue fever cases have spiked recently, leading to severe pain and multiple fatalities.

**India (Karnataka and Uttar Pradesh):** Both Karnataka and Uttar Pradesh have experienced a surge in dengue cases, with patient counts exceeding 200 in Kanpur. The government has initiated action plans and campaigns to control the outbreak.

**Bangladesh:** The country has seen a significant increase in dengue cases, with a rise in deaths and hospitalizations.

**Pakistan (Khyber Pakhtunkhwa):** Dengue cases have been rapidly increasing in several high-risk districts.

**Indonesia:** The country is grappling with a high number of dengue cases, with fatalities reported.

**Guadeloupe and Martinique:** Dengue cases are on the rise in these Caribbean regions.

**Chandigarh:** In the first 11 days of September, Chandigarh has reported 27 dengue cases.

**Sri Lanka:** The country has witnessed a significant number of dengue cases, leading to hospitalizations and fatalities.

**Nepal:** The country has reported dengue cases, causing concern among health officials.

**Philippines:** There have been reports of dengue cases and efforts to raise awareness and control the disease.

**Latin America:** Bolivia has been dealing with dengue outbreaks as well.

Amid these outbreaks, there are efforts to prevent dengue, with innovative approaches and anti-dengue campaigns, but concerns about the government's response and the need for public awareness remain. Some political controversies related to dengue have also emerged in Karnataka.

In summary, dengue fever has become a significant health concern in multiple countries, with various government responses and efforts to control the outbreaks. Public awareness and prevention measures are crucial in combating the spread of the disease.

As a final comparison, what if we switch to the new Bison 32K token model? We'll use the exact same CURL command as above, but change the endpoint to "text-bison-32k".

PaLM 32K First Run:

**India**

– In Uttar Pradesh, the number of dengue cases in Kanpur has crossed 200.
– The Uttarakhand government has launched a four-day campaign to prevent dengue in Dehradun.
– The number of dengue cases in Delhi has reached 1,100 this year.
– The West Bengal government has been criticized for its failure to control dengue.
– A four-year-old boy has died of dengue in Chennai.
– The Karnataka government has issued an alert regarding dengue in the state.
– The Telangana government has warned people to be cautious about mosquito bites.

**Bangladesh**

– The death toll from dengue fever in Bangladesh has risen to 11.
– The number of dengue cases in Bangladesh has crossed 1.5 lakh this year.
– The government has been criticized for its failure to control dengue.
– The BNP has announced a three-day program to raise awareness about dengue prevention.

**Guadeloupe/Martinique**

– The number of dengue cases in Guadeloupe and Martinique is increasing.

**Nepal**

– The number of dengue cases in Nepal is increasing.

**Pakistan**

– The number of dengue cases in Khyber Pakhtunkhwa is increasing.

**Latin America & The Caribbean**

– The number of dengue cases in Bolivia is increasing.

PaLM 32K Second Run:

**India**

– In Uttar Pradesh, the number of dengue cases in Kanpur has crossed 200.
– The Uttarakhand government has launched a four-day campaign to prevent dengue in Dehradun.
– The number of dengue cases in Delhi has reached 1,100 this year.
– In Jammu, 67 cases of dengue have been reported.
– In Chandigarh, 79 cases of dengue have been reported so far this year.
– In Haryana, the number of dengue cases has reached 144.
– In West Bengal, a fourth person has died of dengue in Kolkata in a week.
– In Karnataka, a 4-year-old boy has died of dengue in Chennai.
– The Tamil Nadu Health Department is on alert after the death of the 4-year-old boy.
– In Telangana, the number of dengue cases has crossed 1.5 lakh this year.
– The Bangladesh government has been criticized for its failure to control dengue.
– In Bihar, the number of dengue cases has reached 267.
– In Maharashtra, eight new cases of dengue were reported on Monday, bringing the total number of cases in the state to 422.
– In Noida, the number of dengue cases has increased significantly in the past few days.
– In Rajasthan, the number of dengue cases has reached 1,100 this year.
– In Madhya Pradesh, the number of dengue cases has reached 1,100 this year.
– In Punjab, the number of dengue cases has reached 144 this year.
– In Kerala, two people have died of Nipah virus.

**Latin America & The Caribbean**

– In Bolivia, the number of dengue cases has increased significantly in the past few weeks.

**Nepal**

– In Nepal, three people have been arrested for gambling in a hotel.

PaLM 32K Third Run:

**India**

– In Uttar Pradesh, the number of dengue cases in Kanpur has crossed 200.
– The Uttarakhand government has launched a four-day campaign to prevent dengue in Dehradun.
– The number of dengue cases in Delhi has reached 1,100 this year.
– The West Bengal government has been criticized for its failure to control dengue.
– A four-year-old boy has died of dengue in Chennai.
– The Karnataka government has issued an alert regarding dengue in the state.
– The Telangana government has warned people to be cautious about mosquito bites.
– The DMK MP, A Raja, has sparked controversy by saying that Hinduism is a threat to the entire world.
– Prakash Raj, an actor, has said that Sanatana Dharma is like dengue.
– Sadhvi Pragya Singh Thakur, a BJP MP, has cursed those who oppose Sanatana Dharma.
– The I.N.D.I.A. Alliance has been formed to fight Santana Dharma.
– The Union Health Ministry has issued an advisory on dengue.

**Bangladesh**

– The number of dengue cases in Bangladesh has crossed 1.5 lakh this year.
– The dengue outbreak has hit the poor the hardest.
– The government has been criticized for its failure to control dengue.
– The BNP has announced a three-day program to raise awareness about dengue.
– The government has been accused of corruption in the purchase of Airbus aircraft.
– The death toll from dengue has risen to 11.

**Guadeloupe/Martinique**

– The number of dengue cases in Guadeloupe and Martinique is increasing.

**Nepal**

– The number of dengue cases in Nepal is increasing.

**Latin America & The Caribbean**

– The number of dengue cases in Latin America and the Caribbean is increasing.

**Global**

– The number of dengue cases worldwide is increasing.