Large-Token LLMs: Using GCP’s New 32K PaLM Model To Summarize Two CSPAN Broadcasts

Earlier this month we explored using Google's new 32K PaLM LLM model to summarize an entire evening news broadcast. Let's try using the same process to summarize two CSPAN broadcasts to explore how LLMs might be able to sift through the vast and highly verbose discourse at the root of democratic governance and translate it into more succinct and simplified forms potentially more understandable to the nation's citizenry.

For both of the examples below, we'll use a temperature of 0.2, maxOutputTokens to 8192 and leave all other parameters at their defaults. We'll use the following prompt:

Divide the television news transcript below into a set of discrete stories, make them into a bulleted list with a title and short description and summary of each. Each story should include a Title, Description and Summary. Do not use any information beyond what is in the transcript below.\n\nTELEVISION NEWS TRANSCRIPT:\n

We'll start with this 30-minute broadcast from 2009 broadcast. Our first run yields the following results:

**Story 1: States Facing Steepest Budget Cuts in 30 Years**

* Description: States are facing their steepest budget cuts in 30 years, with spending projected to fall for the second year in a row.
* Summary:
– State spending is estimated to decline 2.2% this fiscal year and 2.5% in the next fiscal year.
– 42 states have had to cut their budgets after passage, the highest number on record.
– 36 states have had to close budget gaps already this fiscal year, and 20 states still have additional shortfalls.
– 37 states expect to have budget gaps in the next fiscal year, and 24 states are reporting they have budget gaps expected in 2011.
– Revenue collections are down significantly in all sources of revenue, with an overall aggregate 6.1% decline year-over-year in the three major sources of revenue: sales, personal income, and corporate income tax.
– Balance levels, as a rainy day fund coupled with the end of year balances, are down but still lag in terms of what would be considered healthy.
– The fiscal situation for states is one of the worst in decades, and whether states will have growth budgets in 2011, 2012, or even 2013 will depend on the length and severity of the recession in addition to other factors.

**Story 2: National Governors' Association Says States Facing $183 Billion Shortfall Over Next Three Years**

* Description: The National Governors' Association (NGA) says states are facing a $183 billion shortfall over the next three years.
* Summary:
– The NGA says states have cut spending by 4.5% over the past two years, and are projecting further cuts of 2.5% in the next fiscal year.
– States are raising taxes by $24 billion in an effort to close the budget gap, but this will not be enough to offset the decline in revenue.
– The NGA warns that states will have to make "significant and painful" cuts to services in order to balance their budgets.
– The NGA is calling on the federal government to provide more aid to states, arguing that the states are facing a "fiscal crisis."

**Story 3: Education Funding by the States**

* Description: Education funding by the states is being cut as states face budget shortfalls.
* Summary:
– The American Recovery and Reinvestment Act (ARRA) provided $135 billion in flexible funding to states, which has helped to protect education funding.
– However, the ARRA funding is not enough to offset the decline in state revenue, and many states are still facing budget shortfalls.
– States are making cuts to education in order to balance their budgets.
– The cuts to education are having a negative impact on students and teachers.
– The NGA is calling on the federal government to provide more aid to states, arguing that the states are facing a "fiscal crisis."

Second run:

**Story 1: States Facing Steepest Budget Cuts in 30 Years**

* Description: States are facing their steepest budget cuts in 30 years, with spending projected to fall for the second year in a row.
* Summary:
– State spending is estimated to decline 2.2% this fiscal year (2009) and 2.5% in fiscal year 2010.
– 42 states have had to cut their budgets after passage, the highest number on record.
– 36 states have had to close budget gaps already this fiscal year, and 20 states still have additional shortfalls.
– 37 states expect to have budget gaps in fiscal year 2010, and 24 states are reporting they have budget gaps expected in 2011.
– Revenue collections are down significantly in all sources of revenue, with an overall aggregate 6.1% decline year-over-year in the three major sources of revenue: sales, personal income, and corporate income tax.
– Balance levels, as a rainy day fund coupled with the end of year balances, are down but still lag in terms of what would be considered healthy.

**Story 2: National Governors' Association Report on State Fiscal Health**

* Description: The National Governors' Association (NGA) has released a new report on state fiscal health, which shows that states are facing their worst budget situation in decades.
* Summary:
– The report found that state spending is projected to decline 2.2% in fiscal year 2009 and 2.5% in fiscal year 2010.
– This is the first time in 30 years that state spending has declined two years in a row.
– The report also found that 42 states have had to cut their budgets after passage, the highest number on record.
– 36 states have had to close budget gaps already this fiscal year, and 20 states still have additional shortfalls.
– 37 states expect to have budget gaps in fiscal year 2010, and 24 states are reporting they have budget gaps expected in 2011.
– Revenue collections are down significantly in all sources of revenue, with an overall aggregate 6.1% decline year-over-year in the three major sources of revenue: sales, personal income, and corporate income tax.
– Balance levels, as a rainy day fund coupled with the end of year balances, are down but still lag in terms of what would be considered healthy.

**Story 3: States Considering Tax Increases to Close Budget Gaps**

* Description: With budget shortfalls looming, states are considering tax increases to close the gaps.
* Summary:
– 24 states are considering tax increases for fiscal year 2010.
– The tax increases are expected to generate $24 billion in revenue.
– This is the largest amount of tax increases that states have considered in recent history.
– The tax increases are being considered in a variety of states, including California, New York, and Illinois.
– The tax increases are controversial, with some people arguing that they will hurt the economy and others arguing that they are necessary to close the budget gaps.

**Story 4: States Facing a "Cliff" When Federal Stimulus Funds Run Out**

* Description: States are facing a "cliff" when federal stimulus funds run out, which could lead to even more budget cuts and tax increases.
* Summary:
– The federal stimulus package provided $135 billion in aid to states.
– This money has helped states to close budget gaps and avoid cuts to essential services.
– However, the stimulus funds will run out in December 2010, and states are worried about what will happen when they do.
– States are already facing budget shortfalls for fiscal year 2011, and the loss of federal stimulus funds will only make things worse.
– States are considering a variety of options to deal with the "cliff," including tax increases, budget cuts, and borrowing.

Third run:

**Story 1: States Facing Steepest Budget Cuts in 30 Years**

* Description: States are facing their steepest budget cuts in 30 years, with spending projected to fall for the second year in a row.
* Summary:
– State spending is estimated to decline 2.2% this fiscal year and 2.5% the following year.
– 42 states have had to cut their budgets after passage, the highest number on record.
– 36 states have already closed budget gaps this year, and 20 more are expected to do so.
– 37 states expect to have budget gaps in 2010, and 24 states are reporting expected budget gaps in 2011.
– Revenue collections are down significantly in all sources of revenue, with a 6.1% decline in the three major sources of revenue: sales, personal income, and corporate income tax.
– The decline in state fiscal conditions is the worst in decades, and it is uncertain when or if states will be able to recover.

**Story 2: National Governors' Association Report on State Fiscal Health**

* Description: The National Governors' Association (NGA) has released a report on state fiscal health, which shows that states are facing significant budget challenges.
* Summary:
– The report found that state spending is projected to decline 2.2% in fiscal year 2009 and 2.5% in fiscal year 2010.
– This is the first time in 30 years that state spending has declined for two consecutive years.
– The report also found that states are facing large budget gaps, with 36 states having already closed budget gaps this year and 20 more expected to do so.
– 37 states expect to have budget gaps in 2010, and 24 states are reporting expected budget gaps in 2011.
– The report concludes that the decline in state fiscal conditions is the worst in decades, and it is uncertain when or if states will be able to recover.

**Story 3: States Turn to Bond Financing to Fill Budget Gaps**

* Description: States are increasingly turning to bond financing to fill budget gaps, as they face the worst fiscal crisis in decades.
* Summary:
– States are expected to issue a record amount of debt this year, with some states borrowing more than ever before.
– The increased borrowing is due to the fact that states are facing large budget deficits and are struggling to find other ways to close the gap.
– Some states are using the bond proceeds to fund operating expenses, while others are using it to finance capital projects.
– The increased borrowing is raising concerns about the states' ability to repay their debts, and some states are being forced to pay higher interest rates on their bonds.
– The trend of states turning to bond financing to fill budget gaps is likely to continue, as the fiscal crisis shows no signs of abating.

What about this one hour and 11 minute CSPAN broadcast from earlier this year?

1. H.R. 2494, the Protect Our Law Enforcement with Immigration Control and Enforcement, or the POLICE Act, would amend the Immigration and Nationality Act to make it a deportable offense to assault a law enforcem
ent officer.
2. H.R. 3091, the Federal Law Enforcement Service Weapons Purchase Act, would allow federal law enforcement officers to purchase retired and surplus military service weapons at fair market value.
3. H.Con.Res. 40, Expressing Support for Local Law Enforcement Officers and Condemning Efforts to Defund or Dismantle Local Law Enforcement Agencies, would express Congress' support for local law enforcement offic
ers and condemn efforts to defund or dismantle local law enforcement agencies.
4. The previous version of H.Con.Res. 40, which was introduced by House Republicans on the first day of the 118th Congress, expressed support for the nation's law enforcement agencies. The new version, which was i
ntroduced by House Republicans on May 4, 2023, only expresses support for local law enforcement agencies.
5. The change in language was made without explanation by House Republicans.
6. Democrats argue that the change in language was made because House Republicans do not support all law enforcement agencies, including the Capitol Police, the FBI, and other federal law enforcement agencies.
7. Republicans argue that the change in language was made to focus on local law enforcement agencies, which are the most important to the safety of most Americans.
8. The debate over the rule providing for consideration of H.R. 2494, H.R. 3091, and H.Con.Res. 40 is ongoing.

Second run:

1. H.R. 2494: To make the assault of a law enforcement officer a deportable offense, and for other purposes.
Description: This bill would make it a deportable offense for an alien to assault a law enforcement officer.
Summary: This bill would make it a crime to assault a law enforcement officer, and would make it a deportable offense for an alien to commit such an assault.

2. H.R. 3091: To allow Federal law enforcement officers to purchase retired service weapons, and for other purposes.
Description: This bill would allow federal law enforcement officers to purchase retired service weapons.
Summary: This bill would allow federal law enforcement officers to purchase retired service weapons at fair market value.

3. H.Con.Res. 40: Expressing support for local law enforcement officers and condemning efforts to defund or dismantle local law enforcement agencies.
Description: This resolution would express support for local law enforcement officers and condemn efforts to defund or dismantle local law enforcement agencies.
Summary: This resolution would express support for local law enforcement officers and condemn efforts to defund or dismantle local law enforcement agencies.

Third run:

1). POLICE ACT (H.R. 2494)
Description: Amends the Immigration and Nationality Act to make it a deportable offense for an alien to assault a law enforcement officer.
Summary: This bill would make it a deportable offense for an alien to assault a law enforcement officer.

2). FEDERAL LAW ENFORCEMENT OFFICERS SERVICE WEAPONS PURCHASE ACT (H.R. 3091)
Description: Allows Federal law enforcement officers to purchase retired or surplus military service weapons at fair market value.
Summary: This bill would allow federal law enforcement officers to purchase retired or surplus military service weapons at fair market value.

3). CONCURRENT RESOLUTION EXPRESSING SUPPORT FOR LOCAL LAW ENFORCEMENT OFFICERS AND CONDEMNING EFFORTS TO DEFUND OR DISMANTLE LOCAL LAW ENFORCEMENT AGENCIES (H. Con. Res. 40)
Description: Expresses the sense of Congress supporting local law enforcement officers and condemning efforts to defund or dismantle local law enforcement agencies.
Summary: This resolution would express the sense of Congress supporting local law enforcement officers and condemning efforts to defund or dismantle local law enforcement agencies.

Fourth run:

Story 1: The House will consider H.R. 2494, the Protect Our Law Enforcement with Immigration Control and Enforcement, or the POLICE Act, which would make it a deportable offense for an alien to assault a law enforcement officer.

Story 2: The House will consider H.R. 3091, the Federal Law Enforcement Service Weapons Purchase Act, which would allow federal law enforcement officers to purchase retired and surplus military service weapons at fair market value.

Story 3: The House will consider H.Con.Res. 40, Expressing Support for Local Law Enforcement Officers and Condemning Efforts to Defund or Dismantle Local Law Enforcement Agencies, which would express Congress' support for local law enforcement officers and condemn efforts to defund or dismantle local law enforcement agencies.

Story 4: The House will also consider a Democratic amendment to H.Con.Res. 40 that would express support for all law enforcement officers, including federal law enforcement officers and Capitol Police officers.

Story 5: The debate on the rule providing for consideration of the three bills and the Democratic amendment is expected to be heated, with Democrats accusing Republicans of trying to politicize the issue of law enforcement and Republicans accusing Democrats of being soft on crime.

What if we change the prompt slightly to reflect that this is a CSPAN broadcast rather than an ordinary television news broadcast?

Divide the US Congress transcript below into a set of discrete stories, make them into a bulleted list with a title and short description and summary of each. Each story should include a Title, Description and Summary. Do not use any information beyond what is in the transcript below.\n\nTELEVISION NEWS TRANSCRIPT:\n

Yielding:

1. H.R. 2494: To make the assault of a law enforcement officer a deportable offense, and for other purposes.
Description: This bill would make it a deportable offense for an alien to assault a law enforcement officer.
Summary: This bill would make it a deportable offense for an alien to assault a law enforcement officer.

2. H.R. 3091: To allow Federal law enforcement officers to purchase retired service weapons, and for other purposes.
Description: This bill would allow Federal law enforcement officers to purchase retired service weapons at fair market value.
Summary: This bill would allow Federal law enforcement officers to purchase retired service weapons at fair market value.

And let's try another formulation:

Divide the US Congressional debate transcript below into a set of discrete stories, make them into a bulleted list with a title and short description and summary of each. Each story should include a Title, Description and Summary. Do not use any information beyond what is in the transcript below.\n\nTELEVISION NEWS TRANSCRIPT:\n

Yielding the following, which is similar to one of the earlier results:

1. H.R. 2494: To make the assault of a law enforcement officer a deportable offense, and for other purposes.
Status: Not yet voted on.
Description: This bill would make it a deportable offense for an alien to assault a law enforcement officer.

2. H.R. 3091: To allow Federal law enforcement officers to purchase retired service weapons, and for other purposes.
Status: Not yet voted on.
Description: This bill would allow federal law enforcement officers to purchase retired service weapons at fair market value.

3. H.Con.Res. 40: Expressing support for local law enforcement officers and condemning efforts to defund or dismantle local law enforcement agencies.
Status: Not yet voted on.
Description: This resolution would express support for local law enforcement officers and condemn efforts to defund or dismantle local law enforcement agencies.

Story 1: The Protect Our Law Enforcement with Immigration Control and Enforcement, or the POLICE Act
The POLICE Act would amend the Immigration and Nationality Act to clearly state that the assault of a law enforcement officer is a deportable offense.

Story 2: The Federal Law Enforcement Service Weapons Purchase Act
The Federal Law Enforcement Service Weapons Purchase Act would allow law enforcement officers to buy retired and surplus military service weapons at fair market value so long as the officer is in good standing with their employed agency.

Story 3: H.Con.Res. 40
H.Con.Res. 40 expresses Congress' support for local law enforcement officers and condemns efforts to defund or dismantle local law enforcement agencies.

Story 4: The Defund the Police Movement
The Defund the Police movement is a movement that calls for reducing or eliminating funding for police departments.

Story 5: The Capitol Police
The Capitol Police is the police force responsible for protecting the United States Capitol and its grounds.

Story 6: The January 6 Capitol Riot
The January 6 Capitol Riot was a riot that occurred at the United States Capitol on January 6, 2021.

Story 7: The Blue Lives Matter Movement
The Blue Lives Matter movement is a movement that supports law enforcement officers and opposes violence against them.

Story 8: The National Police Week
National Police Week is a week-long event that honors law enforcement officers who have died or been injured in the line of duty.

Indeed, running a second time yields results more in line with the previous typical news-oriented prompt results, suggesting the more detailed summary above was due more to random chance than the different prompt instructions:

The GDELT Project

Large-Token LLMs: Using GCP's New 32K PaLM Model To Summarize Two CSPAN Broadcasts

Archives