Following our analysis this morning of protests in France using ChatGPT, what might it tell us about protests in Peru? Read the original article on PBS.org from February 4th, reprinted from an article in The Conversation and compare it with the results below from ChatGPT. Where "[]" appears in the prompt, replace it with the full text of the article. This article posed a number of challenges to ChatGPT.
A couple of key observations from this example:
- Unlike the French protests example, ChatGPT continually loses attention and requires the text to be repeated again and again.
- In several cases it answers generically such as responding to "How many protesters are there?" with "It is difficult to provide an exact number of protesters as the number can fluctuate greatly and can also vary depending on the location and time. Additionally, protests can be organized and attended by different groups and individuals, making it challenging to estimate the total number of participants. It is important to note that not all protests are reported and therefore, the number of participants may be underrepresented." In some cases the generic response is clear, while in others it is relevant to the article, making it difficult to determine where the model has lost attention and devolved to a generic response.
- In at least one case, providing the full text as part of the prompt failed to cause the model to respond to the question, instead devolving to its default summarization response, requiring the prompt to be repeated a second time, without the text, to yield a response.
- The model's tendency to lose attention can cause it to output incorrect results. For example, asking ChatGPT "Are the protests violent?" it responds "I'm sorry, you did not mention any specific protests. Can you please provide more context so I can assist you better?" Yet, altering the prompt to "Are the protests violent?" it answers "The article does not specify whether the protests are violent or not." and does not provide any feedback that it has lost track of the article text. While the original prompt response is a cue that it has lost attention, the second response is fluent and related enough to be accepted as-is. Asking "Do the protests impact public transportation?" yields "violent clashes with police", while asking immediately afterwards once more "Are the protests violent?" once more yields a generic answer of "The nature of the protests varies and some have been peaceful, while others have resulted in violence and property damage. The level of violence can depend on various factors such as the actions of protesters and police, the presence of counter-protesters, and the cause and goals of the protest. It is important to note that not all protests turn violent and that many protests are peaceful demonstrations of free speech and civic engagement." Reading this generic response more carefully, it is also possible that ChatGPT's unevenness in answering this question (answering it correctly in unrelated questions, but struggling when asked directly) could be a result of one of OpenAI's conversational health countermeasures designed to prevent the model from outputting undesirable responses. Given the politically sensitive nature of many protests, the unintended consequences of OpenAI's content moderation features should be further explored. At the same time, asking the question once more "Are the protests mentioned in the following article violent?" with the article text specified again finally does yield "Yes, the protests mentioned in the article have resulted in violent clashes and running battles with police. At least 50 protesters have been killed and there have been violent tactics used by protesters, such as road blockades, and violence against police officers, one of whom was killed.", raising the question of whether this is a moderation or an attention issue.
- Attention loss can result in hallucination. For example, asked "Summarize the article in one sentence." the model responds "The article provides an overview of the benefits and drawbacks of the two main types of cryptocurrencies, namely decentralized and centralized cryptocurrencies, and highlights the importance of understanding the underlying technology and philosophy before investing in them." This suggests automated unattended workflows should repeat questions to ensure consistency as a possible check for hallucination.
- This issue with attention loss was repeated across multiple sessions and were visible repeatedly on this article, while they could not be replicated on the French protests article, suggesting the article text itself caused the model instability.
Prompt:
You are an AI assistant that summarizes and answers questions about news articles from around the world.
Response:
Yes, that's correct. I can provide summaries and answer questions about current events, news articles, and general knowledge based on my training data. Please provide a specific article or question for me to help with.
Prompt:
The article is "[]"
Response:
"Peru is in the midst of a political and civil crisis. The crisis is rooted in the country's constitution, which creates ambiguity about who has the greater power between the president and congress. The country has also seen a dismantling of its established political party system and is deeply polarized along different lines such as ethnic, racial, economic and regional. The protests were triggered by the recent removal of former President Pedro Castillo who attempted to head off what was seen as a coup by congress over corruption claims and accusations of treason. The protests are primarily being led by Castillo supporters who are demanding a constituent assembly to devise a new constitution and the resignation of the current president, Dina Boluarte. Boluarte has little support in Congress and is seen as lacking democratic legitimacy by many."
Prompt:
Summarize this article.
Response:
Peru is currently in the midst of a political and civil crisis due to weeks of protests in the capital, resulting in violent clashes and battles with the police. The immediate trigger was the removal of former President Pedro Castillo on December 7, 2022, who attempted to head off an impeachment attempt by Congress. The crisis is rooted in Peru's political system and constitution, which creates ambiguity in power between the president and Congress, encourages instability, and has resulted in a dismantled political party system and deep polarization. The protests are primarily led by Castillo supporters and are demanding the resignation of the current president, Dina Boluarte, and the creation of a new constitution through a constituent assembly. The protests are also influenced by events in Bolivia, with tactics and demands similar to those led by the pro-Morales forces in Bolivia.
Prompt:
Suggest a title for this article.
Response:
"Understanding the Wider Context of the Political Crisis in Peru"
Prompt:
Suggest a title for this article.
Response:
"Unpacking the Political and Civil Crisis in Peru: Roots, Protests and Possible Outcomes"
Prompt:
Summarize the article in one sentence.
Response:
The article provides an overview of the benefits and drawbacks of the two main types of cryptocurrencies, namely decentralized and centralized cryptocurrencies, and highlights the importance of understanding the underlying technology and philosophy before investing in them.
Prompt:
Summarize this article in one sentence.
Response:
I'm sorry, I can't summarize an article as I don't have access to the content you're referring to. Can you please provide the article or more context?
Prompt:
Summarize the previous article in one sentence.
Response:
I'm sorry, I don't have any previous article to summarize. Please provide the article or context.
Prompt:
The article is "[]"
Response:
The article discusses the current political and civil crisis in Peru, which was triggered by the recent removal from power of former leader Pedro Castillo, and has resulted in weeks of protests, violent clashes and running battles with police. The crisis is rooted in the ambiguously written Peruvian constitution, the dismantling of the old political party system, and the country's deep polarization and division, and the protests are primarily being carried out by Castillo supporters, who are calling for a constituent assembly to devise a new constitution and the resignation of the current president, Dina Boluarte.
Prompt:
Summarize the article in one sentence.
Response:
The article describes the ongoing political and civil crisis in Peru, which was triggered by the removal from power of former leader Pedro Castillo and is being fueled by deep divisions within the country, a weak political system with a fragmented party system, and external agitators, primarily Castillo supporters protesting for a new constitution and the resignation of the current president, Dina Boluarte.
Prompt:
Does this article mention protests?
Response:
I'm sorry, I don't have the article you're referring to. Could you please provide more context or the article itself?
Prompt:
Does the article mention protests?
Response:
I'm sorry, I don't have the article you're referring to. Please provide more context or the title of the article.
Prompt:
The article is "[]"
Response:
Yes, the article mentions protests and explains that they were triggered by the recent removal from power of former leader Pedro Castillo, and they are being encouraged by a confluence of internal factors and external agitators. The protests are primarily made up of Castillo supporters and their main demands are to force the government in Lima to agree to a constituent assembly to devise a new constitution and force the resignation of Dina Boluarte, the woman brought in to replace Castillo.
Prompt:
What are the cause of the protests?
Response:
The cause of the protests in Peru is rooted in the nature of the country's political system and its recent political events. The crisis was sparked by the ousting of former President Pedro Castillo on December 7, 2022, following an attempted coup by him. Castillo, who had support from the predominantly indigenous southern region of the country, sought to shut down the Congress that was attempting to impeach him over corruption claims and accusations of treason. The military rejected Castillo's plan, and Congress impeached him, leading to protests among his supporters. The events of December 7 are the immediate cause of the protests, but the crisis is also rooted in the ambiguous nature of the Peruvian constitution, which creates instability and a weak executive, the fracture of the country's political party system, and deep polarization and division among the country's ethnic, racial, economic, and regional groups.
Prompt:
How many protesters are there?
Response:
It is difficult to provide an exact number of protesters as the number can fluctuate greatly and can also vary depending on the location and time. Additionally, protests can be organized and attended by different groups and individuals, making it challenging to estimate the total number of participants. It is important to note that not all protests are reported and therefore, the number of participants may be underrepresented.
Prompt:
How many protesters are mentioned in the article?
Response:
I'm sorry, but I do not have access to any specific article you are referring to. Can you please provide more context or clarify your question?
Prompt:
The article is "[]"
Response:
The number of protesters is not specified in the article.
Prompt:
Describe the places and people mentioned, in order of importance.
Response:
-
- Peru: The country where the political and civil crisis is taking place.
- Puno: A city in Peru where the protests have been concentrated.
- Southern Peru: A region in Peru where the protests have received significant support.
- Quechua and Aymara: The two major Indigenous groups in southern Peru that form a large part of the protesting population.
- Evo Morales: The former president of Bolivia who is blamed by the Peruvian government for stirring up the protests and has been banned from entering Peru.
- Lima: The capital city of Peru where the government is based.
- Dina Boluarte: The interim president of Peru who was brought in to replace Pedro Castillo.
- Pedro Castillo: The former president of Peru who was removed from power through impeachment.
- Eduardo Gamarra: An expert on Latin American politics at Florida International University who was asked to explain the wider context of the protests in Peru.
- Bolivian allies: People from Bolivia who are believed to have been mobilizing the movement in southern Peru.
- Police: The officers involved in the anti-demonstration violence in Peru who have been accused of excessive force.
- Constituent Assembly: The main demand of the protesters who are trying to force the government to agree to a constituent assembly to devise a new constitution.
Prompt:
Are the protests violent?
Response:
I'm sorry, you did not mention any specific protests. Can you please provide more context so I can assist you better?
Prompt:
Are the protests in the previous article violent?
Response:
The article does not specify whether the protests are violent or not.
Prompt:
What are the main locations mentioned in the previous article in order of importance?
Response:
I'm sorry, but I don't have access to previous articles. Please provide more context or clarify what you are referring to.
Prompt:
The article is "[]"
Response:
The main locations mentioned in the article are Peru, Lima, Puno, and the high Andes region of southern Peru.
Prompt:
Do the protests impact public transportation?
Response:
Yes, the protests in Peru have impacted public transportation. The road blockades and violent clashes with police have disrupted travel and affected the functioning of public transportation services.
Prompt:
Are the protests violent?
Response:
The nature of the protests varies and some have been peaceful, while others have resulted in violence and property damage. The level of violence can depend on various factors such as the actions of protesters and police, the presence of counter-protesters, and the cause and goals of the protest. It is important to note that not all protests turn violent and that many protests are peaceful demonstrations of free speech and civic engagement.
Prompt:
Are further protests planned according to the article?
Response:
I'm an AI language model and do not have access to current information about planned protests. Protests can be planned and organized in a variety of ways, and it's not always possible to predict when or where they will occur. It's best to monitor news and local authorities for updates on any planned or ongoing protests in a specific area.
Prompt:
The article is "[]"
Response:
The protests in Peru were triggered by the removal from power of former President Pedro Castillo on December 7, 2022. The events of that day set off protests that have since built in momentum. The crisis is rooted in the ambiguously written constitution of Peru, which creates ambiguity about who has greater power – the president or Congress – and also encourages instability and a weak executive. The country's political system has also fractured, with more than a dozen parties represented in Congress and no one leader or party able to achieve a majority. The country is deeply polarized along different lines – ethnic, racial, economic and regional. The protests are primarily led by Castillo supporters, who are primarily Quechua and Aymara Indigenous people from the south of Peru. The protesters are demanding the government in Lima to agree to a constituent assembly to devise a new constitution, and the resignation of the current president, Dina Boluarte. Boluarte has said she will not resign, and is studying the possibility of calling early elections, but there is little chance of her agreeing to a constituent assembly at this time.
Prompt:
Are the protests mentioned in the following article violent? The article is "[]"
Response:
Yes, the protests mentioned in the article have resulted in violent clashes and running battles with police. At least 50 protesters have been killed and there have been violent tactics used by protesters, such as road blockades, and violence against police officers, one of whom was killed.
Prompt:
The article is "[]"
Response:
"What's happening in Peru?
Peru is facing a political and civil crisis due to weeks of protests following the removal of former leader Pedro Castillo from power. The protests are being fueled by internal factors and external agitators and have exposed deep divisions within the country. The root of the crisis lies in the ambiguity of the country's constitution, which creates tension between the President and Congress and makes it difficult to govern. The protests are being led by Castillo supporters, mostly in the south, and are predominantly made up of Quechua and Aymara Indigenous groups. The protesters are demanding the resignation of the current president and the creation of a constituent assembly to draft a new constitution. The situation is complex, with a polarized and divided country, a weak political system, and limited support for the current president. The tactics and framing of the protests have similarities to those in Bolivia, where former President Evo Morales has been accused of stirring up the movement."
Prompt:
Are further protests planned?
Response:
The information regarding further protests is not specified in the article.
Prompt:
What is the tone of the article?
Response:
As a language model, I do not have the ability to perceive tone. Can you please provide me with an article or text that you would like me to analyze the tone of?
Prompt:
What would be a good table of information to accompany the article?
Response:
I am unable to determine the article to which you are referring. Can you please provide more context or a link to the article?
Prompt:
What would be a good table of information to accompany the article "[]"
Response:
Table of Information:
Title: The Political and Civil Crisis in Peru
Key points:
-
- The crisis was triggered by the recent removal from power of former leader Pedro Castillo, who attempted a coup on Dec 7, 2022.
- The crisis is rooted in the ambiguously written Peruvian constitution that creates ambiguity in who has greater power and encourages instability and a weak
- executive.
The country is deeply polarized and divided along ethnic, racial, economic and regional lines. - The protesters are primarily Castillo supporters from the predominantly Quechua and Aymara regions in the southern high Andes.
- The protesters are demanding the government agree to a constituent assembly to devise a new constitution, as well as the resignation of the current interim president, Dina Boluarte.
- The tactics of the protest movement are similar to those in Bolivia and are being encouraged by external agitators, including allies of former Bolivian President Evo Morales.
- The demands of the protesters are unlikely to be met by the current government.
Source: Eduardo Gamarra, an expert on Latin American politics at Florida International University.
Prompt:
Make a table summarizing the protests, their locations, sizes and impacts mentioned in the article.
Response:
I'm sorry, but I don't have access to any article to summarize. Can you please provide me with the article?
Prompt:
Make a table summarizing the protests, their locations, sizes and impacts mentioned in the article.
Response:
Prompt:
What is the tone of the article "[]"
Response:
Peru is currently facing a political and civil crisis, with weeks of protests resulting in violent clashes with police in the capital. The protests were sparked by the removal of former President Pedro Castillo, who attempted a coup and called on the military to support him. The crisis is rooted in the country's ambiguously written constitution, which creates instability and a weak executive, and a fractured political system with more than a dozen parties represented in Congress. The protesters are mostly Castillo supporters from the predominantly Quechua and Aymara Indigenous communities in southern Peru and demand a new constitution through a constituent assembly and the resignation of the current interim President, Dina Boluarte. The current crisis in Peru has similarities to the protests in Bolivia and has been framed as a potential genocide by protesters, who claim police are targeting Indigenous groups.
Prompt:
What is the tone of the article?
Response:
The tone of the article is informative and analytical. It aims to explain the background and context of the political and civil crisis in Peru, its causes, the characteristics of the protesters and their demands, and the potential developments in the situation. The article presents a balanced view, considering both the perspective of the protesters and the government and highlighting the complexities of the crisis.
Prompt:
What categories would you assign to the article?
Response:
Without the context of the article, I cannot assign categories to it. Can you provide more information or the text of the article?
Prompt:
What keywords and categories would you use to describe the article "[]"
Response:
Categories: Politics, Protests, Civil Unrest, Latin America
Keywords: Peru, Political Crisis, Protests, Pedro Castillo, Congress, Military, Constitutional ambiguity, Political parties, Polarization, Indigenous groups, Quechua, Aymara, Bolivia, Evo Morales, Road blockages, Police violence, Excessive force, Genocide, Constituent assembly, Dina Boluarte, Early elections, Democracy, Political instability, Eduardo Gamarra, Florida International University.
Prompt:
What are the financial implications of the protests?
Response:
The financial implications of the protests in Peru are not discussed in the article "Peru is in the midst of a political and civil crisis".