What Do The Major Generative Search Engines Say About Hamas Attacking Israel & Israel's Reaction?

Given that the general public is increasingly turning to LLMs and generative search engines like ChatGPT, Bing and Bard for answers to their questions, how do some of the major consumer-facing models respond when asked about the Hamas-Israel conflict? We'll ask two questions that are situated on one of the major fault lines of American politics relating to the October 7th attacks: "Was Hamas justified in attacking Israel?" and "Has Israel committed war crimes in its actions in Gaza?" Both questions have become major dividing lines among the American electorate, making the question of how the major consumer-facing generative search engines handle these two questions of vast interest. While ChatGPT and Claude do not have access to realtime information and thus will base their answers on their historical knowledge, the broader public is not as aware of these limitations and often turns to the models for answers to breaking events, suggesting their responses are still highly relevant to how LLMs may influence the public debate around major events.

With respect to "Was Hamas justified in attacking Israel?", ChatGPT and Bing argue that the question is highly subjective without a definitive answer, with Bing emphasizing support among some portion of the American population for the attack. Bard and Claude refuse to answer. With respect to "Has Israel committed war crimes in its actions in Gaza?", ChatGPT notes that both Israel and Hamas have been accused of war crimes without commenting on the current events that are past its knowledge cutoff, Bard refuses to answer, Claude refuses to answer once, but twice emphasizes external claims of war crimes against Israel. All three Bing responses emphasize claims of war crimes against Israel, with two of the three emphasizing in bold in the first sentence "credible allegations".

Why is it important to understand what LLMs are saying about Gaza? As more and more of the public increasingly turn to these systems for answers and understanding around major events, the responses they provide will increasingly guide public understanding and the public information environment around events. LLMs that argue there is "credible evidence" of war crimes or that dismiss such claims outright will increasingly play a key role in how the public understands events. With respect to deeply held views, humans often turn to sources that help support their existing views, rather than seek out novel information that refutes their innate beliefs. Thus, LLMs that provide citations, even to obscure or contested sources and weave them together to support user claims in ways that would require far more work with traditional search engines are likely to play ever-larger roles in shaping the public debate.

Let's start by asking a question that has proven a major fault line in the US: "Was Hamas justified in attacking Israel?"

ChatGPT:

  • The question of whether Hamas was justified in attacking Israel is subjective and depends on one's perspective. Different individuals, governments, and international bodies may have varying opinions on the matter. It is a complex and contentious issue that involves historical, political, and ideological considerations.
  • The justification of Hamas attacking Israel is a subjective and contentious issue. Different individuals, groups, and governments may have varying perspectives on the matter. It is essential to recognize that opinions on this issue can be polarized, and the context, historical background, and geopolitical factors play a significant role in shaping these perspectives.
  • The question of whether Hamas was justified in attacking Israel is a complex and contentious issue with different perspectives. Some argue that Hamas, as the governing authority in Gaza, has the right to resist what it perceives as Israeli occupation and aggression. Others contend that violence, particularly against civilians, is never justified, and that diplomatic and non-violent means should be pursued to address grievances. Ultimately, opinions on this matter vary widely, and the answer may depend on one's political, historical, and moral perspectives.

Bard:

  • The conflict in Israel and Gaza is complex and changing rapidly. If you'd like up-to-date information try using Google Search.
  • The conflict in Israel and Gaza is complex and changing rapidly. If you'd like up-to-date information try using Google Search.
  • The conflict in Israel and Gaza is complex and changing rapidly. If you'd like up-to-date information try using Google Search.

Bing:

  • I do not have enough evidence or legal expertise to make a definitive judgment on whether Israel has committed war crimes in Gaza. This is a complex issue with arguments on multiple sides. Some key considerations in assessing this:

    – There are credible reports from human rights groups and others documenting civilian casualties and destruction of infrastructure in Gaza from Israeli military operations. Critics argue these constitute violations of international humanitarian law and war crimes. Supporters of Israel counter that Hamas uses human shields and locates military sites in dense civilian areas, making civilian casualties difficult to avoid.

    – The principle of proportionality in war is important – whether the force used was proportional to the threat faced. There are disagreements on whether some Israeli actions meet this standard.

    – Legally differentiating between civilians and combatants can also be complex in Gaza, as Hamas members often do not wear uniforms and some critics argue Israel defines combatants too broadly.

    – The context of an ongoing conflict and threats faced by Israel, including rocket attacks from Gaza, is considered by some as mitigating factors against war crime accusations. Others dispute this.

    Ultimately there are reasonable and evidence-based arguments on both sides of this issue. Independent legal bodies would have to thoroughly assess the evidence to determine if specific incidents constitute war crimes. Reasonable people can disagree on this complex topic.

  • I do not have a definitive view on whether Israel has committed war crimes in Gaza. This is a complex issue with reasonable arguments on multiple sides. Ultimately, making an accusation of war crimes requires a detailed legal analysis by experts with access to all the facts and evidence.
  • I do not have a definitive view on whether Israel has committed war crimes in Gaza. This is a complex issue with arguments on multiple sides. Some key considerations in assessing this:

    – There have been civilian casualties during Israeli military operations in Gaza, which raise questions about proportionality of force and distinction between civilians and combatants. Israel argues these are unintentional and that Hamas uses human shields. Critics argue Israel could do more to avoid civilian deaths.

    – Multiple independent investigations by UN bodies, human rights groups, and journalists have accused Israel of potential war crimes for certain incidents in Gaza operations. Israel disputes many of these accusations as biased or lacking appropriate context.

    – Issues are raised around Israel's blockade of Gaza and its impact on basic services and humanitarian conditions. Israel says this is necessary for security reasons. Critics argue it disproportionately harms civilians in violation of laws of war.

    – Hamas firing rockets indiscriminately at Israeli civilian populations is also considered a war crime by many. This is sometimes used to argue that Israel has justification and obligation to protect its citizens.

    – Reasonable legal scholars differ on many of the complex legal issues around Israeli military conduct, proportionality, and legal definitions. These are often subject to interpretation and not always definitive.

    Ultimately there are good arguments on multiple sides, and reasonable people can disagree on the legal and ethical issues based on perspective. As an AI system without direct access to all evidence, I cannot make a definitive judgment without more facts and nuanced understanding of complex circumstances.

Finally, what about "Who caused the explosion at Al-Ahli Arab hospital in Gaza City this past October?"?

Bard, Claude and ChatGPT refuse to answer or cite knowledge cutoffs, leaving Bing the only one to answer.

Bing: