The GDELT Project

Using ChatGPT + CSPAN To Automatically Identify Mentions Of House Resolutions & Bills In Congressional Transcripts

Kalev Leetaru

Could we use ChatGPT to analyze a CSPAN broadcast of a House of Representatives session and automatically identify all mentions of resolutions and bills? To explore this idea, we'll take this video from the floor of the US House of Representatives from December 6, 2022:

We will then chunk it into blocks of text below ChatGPT's input limits and ask it to identify all of the bills and resolutions mentioned within:

Prompt: 

Make a bulleted list of all of the congressional bills and resolutions mentioned in the transcript: "THE SPEAKER: THE HOUSE WILL BE IN ORDER. THE PRAYER WILL BE OFFERED BY OUR CHAPLAIN, CHAPLAIN KIBBEN. CHAPLAIN KIBBEN: WOULD YOU PRAY WITH ME. PREPARE OUR HEARTS, O PREPARE OUR HEARTS OVERBOARD. MAKE THE WAY STRAIGHT. THEN MADE THE VALLEYS OF DISCORDANT VOICES BE FILLED IN. EVERY MOUNTAIN OF PRIDE EVERY PE BECOME A PLATEAU OF COLLEGIAL DISCOURSE. AND THE ROUGH PLACES OF DOUBT BECOME A PLANE SMOOTHED BY FAITH. REVEAL TO US, O LORD, THE GLORY OF YOUR PRESENCE THAT ALL OF US FROM EVERY CORNER, FROM EACH SIDE OF THE DIVIDE, WOULD SEE IT TOGETHER. SPEAK, O LORD, THAT THE WORDS FROM YOUR MOUTH WOULD BE SWEET TO OUR EARS AND SPOKEN FROM OUR LIPS. THEN, LORD, COME WITH MIGHT THAT YOUR ARM WOULD RULE IN OUR LIVES AND OUR REWARD WOULD BE TO DWELL IN YOUR GENEROUS AND GRACIOUS PRESENCE. FEED US, O SHEPHERD, WITH YOUR WORD. GATHER US TOGETHER LIKE SHEEP IN YOUR FOLD. CARRY THIS BODY CLOSE WITH YOU THAT WE WOULD REMAIN WITH YOU THIS DAY AND ALWAYS. IN THE STRENGTH OF YOUR NAME WE PRAY. AMEN. THE SPEAKER: THE CHAIR HAS EXAMINED THE JOURNAL OF THE LAST DAY'S PROCEEDINGS AND ANNOUNCES TO THE HOUSE THE APPROVAL THEREOF. PURSUANT TO CLAUSE 1 OF RULE 1, THE JOURNAL STANDS APPROVED. THE PLEDGE OF ALLEGIANCE WILL BE LED BY THE GENTLEMAN FROM MASSACHUSETTS, MR. MCGOVERN. MR. MCGOVERN: I PLEDGE ALLEGIANCE TO THE FLAG OF THE UNITED STATES OF AMERICA AND TO THE REPUBLIC FOR WHICH IT STANDS, ONE NATION UNDER GOD, INDIVISIBLE, WITH LIBERTY AND JUSTICE FOR ALL. THE SPEAKER PRO TEMPORE: FOR WHAT PURPOSE DOES THE GENTLEMAN FROM MASSACHUSETTS SEEK RECOGNITION? MR. MCGOVERN: MR. SPEAKER, HE SENDS TO THE DESK A PRIVILEGED REPORT FROM THE COMMITTEE ON RULES FOR FILING UNDER THE RULE. THE SPEAKER PRO TEMPORE: THE CLERK WILL REPORT THE TITLE. THE CLERK: REPORT TO ACCOMPANY HOUSE RESOLUTION 1508, RESOLUTION PROVIDING FOR CONSIDERATION OF THE BILL H.R. 3648, TO AMEND THE IMMIGRATION AND NATIONALITY ACT TO ELIMINATE THE PER COUNTRY NUMERICAL LIMITATION FOR EMPLOYMENT-BASED IMMIGRANTS, TO INCREASE THE PER COUNTRY NUMERICAL IMMIGRATION FOR FAMILIES SPONSORED, IMMIGRANTS, AND FOR OTHER PURPOSES. PROVIDING FOR CONSIDERATION OF THE BILL H.R. 7946, TO PROVIDE BENEFITS FOR NONCITIZEN MEMBERS OF THE ARMED FORCES AND FOR OTHER PURPOSES, AND FOR OTHER PURPOSES. THE SPEAKER PRO TEMPORE: REFERRED TO THE HOUSE CALENDAR AND ORDERED PRINTED. FOR WHAT PURPOSE DOES THE GENTLEMAN FROM MASSACHUSETTS SEEK RECOGNITION? MR. MCGOVERN: MR. SPEAKER, FOR THE PURPOSES OF DEBATE ONLY, I YIELD THE CUSTOMARY 30 MIN MINUTES — MR. SPEAKER, BY DIRECTION OF THE COMMITTEE ON RULES I CALL UP HOUSE RESOLUTION 1508 AND ASK FOR ITS IMMEDIATE CONSIDERATION. THE SPEAKER PRO TEMPORE: THE CLERK WILL REPORT THE RESOLUTION. THE CLERK: HOUSE CALENDAR NUMBER 155, MEUTION 1508. RESOLVED, THAT UPON ADOPTION OF THIS RESOLUTION IT SHALL BE IN ORDER TO CONSIDER IN THE HOUSE THE BILL, H.R. 3648, TO AMEND THE IMMIGRATION AND NATIONALITY ACT TO ELIMINATE THE PER-COUNTRY NUMERICAL LIMITATION FOR EMPLOYMENT-BASED IMMIGRANTS, TO INCREASE THE PER-COUNTRY NUMERICAL LIMITATION FOR FAMILY-SPONSORED IMMIGRANTS, AND FOR OTHER PURPOSES."

ChatGPT:

House Resolution 1508, providing for consideration of:

Here ChatGPT correctly picks out all three bills and their connection.

Prompt: 

Make a bulleted list of all of the congressional bills and resolutions mentioned in the transcript: "ALL POINTS OF ORDER AGAINST CONSIDERATION OF THE BILL ARE WAIVED. THE AMENDMENT IN THE NATURE OF A SUBSTITUTE RECOMMENDED BY THE COMMITTEE ON THE JUDICIARY NOW PRINTED IN THE BILL, MODIFIED BY THE AMENDMENT PRINTED IN PART A OF THE REPORT OF THE COMMITTEE ON RULES ACCOMPANYING THIS RESOLUTION, SHALL BE CONSIDERED AS ADOPTED. THE BILL, AS AMENDED, SHALL BE CONSIDERED AS READ. ALL POINTS OF ORDER AGAINST PROVISIONS IN THE BILL, AS AMENDED, ARE WAIVED. THE PREVIOUS QUESTION SHALL BE CONSIDERED AS ORDERED ON THE BILL, AS AMENDED, AND ON ANY FURTHER AMENDMENT THERETO, TO FINAL PASSAGE WITHOUT INTERVENING MOTION EXCEPT, ONE, ONE HOUR OF DEBATE EQUALLY DIVIDED AND CONTROLLED BY THE CHAIR AND RANKING MINORITY MEMBER OF THE COMMITTEE ON THE JUDICIARY OR THEIR RESPECTIVE DESIGNEES, TWO, THE FURTHER AMENDMENT PRINTED IN PART B OF THE REPORT OF THE COMMITTEE ON RULES ACCOMPANYING THIS RESOLUTION, IF OFFERED BY THE MEMBER DESIGNATED IN THE REPORT, WHICH SHALL BE IN ORDER WITHOUT INTERVENTION OF ANY POINT OF ORDER, SHALL BE CONSIDERED AS READ, SHALL BE SEPARATELY DEBATABLE FOR THE TIME SPECIFIED IN THE REPORT EQUALLY DIVIDED AND CONTROLLED BY THE PROPONENT AND AN OPPONENT, AND SHALL NOT BE SUBJECT TO A DEMAND FOR DIVISION OF THE QUESTION, AND, THREE, ONE MOTION TO RECOMMIT. SECTION 2. UPON ADOPTION OF THIS RESOLUTION IT SHALL BE IN ORDER TO CONSIDER IN THE HOUSE THE BILL, H.R. 7946, TO PROVIDE BENEFITS FOR NONCITIZEN MEMBERS OF THE ARMED FORCES, AND FOR OTHER PURPOSES. ALL POINTS OF ORDER AGAINST CONSIDERATION OF THE BILL ARE WAIVED. THE AMENDMENT IN THE NATURE OF A SUBSTITUTE RECOMMENDED BY THE COMMITTEE ON THE JUDICIARY NOW PRINTED IN THE BILL SHALL BE CONSIDERED AS ADOPTED. THE BILL, AS AMENDED, SHALL BE CONSIDERED AS READ. ALL POINTS OF ORDER AGAINST PROVISIONS IN THE BILL, AS AMENDED, ARE WAIVED. THE PREVIOUS QUESTION SHALL BE CONSIDERED AS ORDERED ON THE BILL, AS AMENDED, AND ON ANY FURTHER AMENDMENT THERETO, TO FINAL PASSAGE WITHOUT INTERVENING MOTION EXCEPT, ONE, ONE HOUR OF DEBATE EQUALLY DIVIDED AND CONTROLLED BY THE CHAIR AND RANKING MINORITY MEMBER OF THE COMMITTEE ON THE JUDICIARY OR THEIR RESPECTIVE DESIGNEES, TWO, THE FURTHER AMENDMENT PRINTED IN PART C OF THE REPORT OF THE COMMITTEE ON RULES ACCOMPANYING THIS RESOLUTION, IF OFFERED BY THE MEMBER DESIGNATED IN THE REPORT, WHICH SHALL BE IN ORDER WITHOUT INTERVENTION OF ANY POINT OF ORDER, SHALL BE CONSIDERED AS READ, SHALL BE SEPARATELY DEBATABLE FOR THE TIME SPECIFIED IN THE REPORT EQUALLY DIVIDED AND CONTROLLED BY THE PROPONENT AND AN OPPONENT, AND SHALL NOT BE SUBJECT TO A DEMAND FOR DIVISION OF THE QUESTION; AND (3) ONE MOTION TO RECOMMIT. SECTION 3. A, AT ANY TIME THROUGH THE LEGISLATIVE DAY OF THURSDAY, DECEMBER 8, 2022, THE SPEAKER MAY ENTERTAIN MOTIONS OFFERED BY THE MAJORITY LEADER OR A DESIGNEE THAT THE HOUSE SUSPEND THE RULES AS THOUGH UNDER CLAUSE 1 OF RULE 15 WITH RESPECT TO MULTIPLE MEASURES DESCRIBED IN SUBSECTION (B), AND THE CHAIR SHALL PUT THE QUESTION ON ANY SUCH MOTION WITHOUT DEBATE OR INTERVENING MOTION."

ChatGPT:

Here ChatGPT correctly identifies H.R. 7946, but gets bogged down in the intricate references and includes them as bills.

Importantly, it hallucinates from whole cloth the reference to H.R. 550. Worse, the actual H.R. 550 is the "Immunization Infrastructure Modernization Act of 2021," while the "Merchant Mariners of World War II Congressional Gold Medal Act of 2021" is actually H.R. 5671. Thus, not only did ChatGPT hallucinate the reference to the bill, it conflated two different bills.

Prompt: 

Make a bulleted list of all of the congressional bills and resolutions mentioned in the transcript: " B, A MEASURE REFERRED TO IN SUBSECTION (A) INCLUDES ANY MEASURE THAT WAS THE OBJECT OF A MOTION TO SUSPEND THE RULES ON THE LEGISLATIVE DAY OF DECEMBER 5, 2022, DECEMBER 6, 2022, DECEMBER 7, 2022, OR DECEMBER 8, 2022, IN THE FORM AS SO OFFERED, ON WHICH THE YEAS AND NAYS WERE ORDERED AND FURTHER PROCEEDINGS POSTPONED PURSUANT TO CLAUSE 8 OF RULE 20. C, UPON THE OFFERING OF A MOTION PURSUANT TO SUBSECTION (A) CONCERNING MULTIPLE MEASURES, THE ORDERING OF THE YEAS AND NAYS ON POSTPONED MOTIONS TO SUSPEND THE RULES WITH RESPECT TO SUCH MEASURES IS VACATED TO THE END THAT ALL SUCH MOTIONS ARE CONSIDERED AS WITHDRAWN. SECTION 4. NOTWITHSTANDING CLAUSE 8 OF RULE 20, FURTHER PROCEEDINGS ON A VOTE BY THE YEAS AND NAYS ON THE QUESTION OF ADOPTION OF A MOTION THAT THE HOUSE SUSPEND THE RULES OFFERED ON THE LEGISLATIVE DAY OF DECEMBER 5, 2022 MAY BE POSTPONED THROUGH THE LEGISLATIVE DAY OF DECEMBER 8, 2022. SECTION 5. THE REQUIREMENT OF CLAUSE 6-A OF RULE 13 FOR A TWO-THIRDS VOTE TO CONSIDER A REPORT FROM THE COMMITTEE ON RULES ON THE SAME DAY IT IS PRESENTED TO THE HOUSE IS WAIVED WITH RESPECT TO ANY RESOLUTION REPORTED THROUGH THE REMAINDER OF THE ONE HUNDRED SEVENTEENTH CONGRESS. THE SPEAKER PRO TEMPORE: THE GENTLEMAN FROM MASSACHUSETTS IS RECOGNIZED FOR ONE HOUR. MR. MCGOVERN: MR. SPEAKER, NOW FOR THE PURPOSES OF DEBATE ONLY, I YIELD THE CUSTOMARY 30 MINUTES TO THE GENTLELADY FROM MINNESOTA, PENDING WHICH I YIELD MYSELF SUCH TIME AS I MAY CONSUME. DURING CONSIDERATION OF THIS RESOLUTION, ALL TIME YIELDED IS FOR THE PURPOSES OF DEBATE ONLY. I ASK UNANIMOUS CONSENT THAT ALL MEMBERS MAY HAVE FIVE LEGISLATIVE DAYS TO REVISE AND EXTEND THEIR REMARKS. THE SPEAKER PRO TEMPORE: WITHOUT OBJECTION. MR. MCGOVERN: MR. SPEAKER, YESTERDAY THE RULES COMMITTEE MET AND REPORTED A RULE, HOUSE RESOLUTION 1508, PROVIDING FOR CONSIDERATION OF TWO MEASURES. H.R. 3648 AND H.R. 7946. THE RULE PROVIDES FOR CONSIDERATION OF BOTH H.R. 3648 AND H.R. 7946, UNDER STRUCTURED RULES WITH ONE HOUR OF DEBATE EACH EQUALLY DIVIDED AND CONTROLLED BY THE CHAIR AND RANKING MINORITY MEMBER OF THE COMMITTEE ON THE JUDICIARY. SELF-EXECUTES A MANAGER'S AMENDMENT FROM CHAIRMAN NADLER FOR H.R. 3648, MAKES IN ORDER ONE AMENDMENT FOR EACH BILL, AND PROVIDES ONE MOTION TO RECOMMIT FOR EACH MEASURE. THE RULE PROVIDES THE MAJORITY LEADER OR HIS DESIGNEE THE ABILITY THIS WEEK TO EN BLOC REQUESTED ROLL CALL VOTES ON SUSPENSIONS."

ChatGPT:

Here ChatGPT correctly identifies all three resolutions, though it is unable to look beyond the literal word usage of "House Resolution" versus "H.R." to recognize that the latter is an abbreviation of the former.

Prompt: 

Make a bulleted list of all of the congressional bills and resolutions mentioned in the transcript: " THE RULE ALSO PROVIDES THAT ROLL CALL VOTES ON SUSPENSION BILLS CONSIDERED ON DECEMBER 5 MAY BE POSTPONED THROUGH DECEMBER 8. LASTLY, THE RULE PROVIDES SAME DAY AUTHORITY FOR ANY RULE REPORTED THROUGH THE REMAINDER OF THE 117TH CONGRESS. MR. SPEAKER, TODAY WE WILL CONSIDER TWO BILLS TO REFORM OUR IMMIGRATION SYSTEM. OUR CURRENT LAWS THAT GOVERN EMPLOYMENT-BASED AND FAMILY-SPONSORED IMMIGRATION VISAS, DESPERATELY NEED UPDATES. ESTIMATES SUGGEST MORE THAN 880,000 PEOPLE ARE IN THE GREEN CARD BACKLOG BECAUSE OF HOW BROKEN OUR SYSTEM IS. H.R. 3648, THE EQUAL ACCESS TO GREEN CARDS FOR LEGAL EMPLOYMENT, OR EAGLE ACT, OF 2022 BEGINS TO ADDRESS THE EXTENSIVE GREEN CARD BACKLOG. THE LEGISLATION ELIMINATES PER COUNTRY CAPS ON EMPLOYMENT-BASED VISAS AND RAISES PER COUNTRY CAPS ON FAMILY BASED VISAS TO 15%. THE OTHER BILL IS H.R. 7946, THE VETERANS SERVICE RECOGNITION ACT. IMPROVES THE NATURALIZATION FOR NONCITIZENS WHO SERVED IN OUR COUNTRY'S MILITARY. IT SEEMS STRAIGHTFORWARD TO ME. IF YOU ARE RISKED YOUR LIFE TO PROTECT AND DEFEND THIS COUNTRY, YOU AND YOUR FAMILY DESERVE EVERY OPPORTUNITY TO BECOME A U.S. CITIZEN IF DESIRED. WHILE THESE TWO BILLS ARE IMPORTANT REFORMS TO OUR IMMIGRATIONCIES TERNLINGS I STILL PERSONALLY BELIEVE THERE ARE ALSO OTHER URGENT IMMIGRATION ISSUES THAT NEED TO BE ADDRESSED BEFORE THE 117TH CONGRESS ADJOURNS. WE NEED RESIDENCY FOR DREAMERS. THESE YOUNG PEOPLE WHO HAVE KNOWN NO OTHER HOME BUT THE UNITED STATES. WE MUST PROVIDE SECURE, STABLE IMMIGRATION FOR AGRICULTURAL WORKERS TO ENSURE FOOD REACHES OUR TABLES. WE SHOULD RECAPTURE EXISTING WE CAN REALLY MAKE A SIZABLE DENT IN REDUCING IMMIGRATION BACKLOGS. AND WE NEED TO REGULARIZE THE STATUS OF LONG-TERM T.P.S. HOLDERS WHO HAVE BEEN HERE FOR DECADES AND ARE IMPORTANT MEMBERS OF OUR LOCAL COMMU COMMUNITIES. REPUBLICANS ALWAYS TALK ABOUT THE ISSUE WITHIN OUR IMMIGRATIOT ISSUES WITHIN OUR IMMIGRATION SYSTEM, BUT SO FAR NONE HAVE COME TO THE TABLE WITH ANY MEANINGFUL OR REALISTIC OR PRODUCTIVE SOLUTION THAT IS WOULD HELP FIX IT. THEY CAN'T GET TO YES ON ANYTHING. THEY DEMONIZE IMMIGRANTS. THEY SCAPEGOAT IMMIGRANTS. AND RATHER THAN FIX THE CHALLENGES OF OUR SYSTEM, THEY USE IMMIGRATION AS A WEDGE ISSUE."

ChatGPT:

Here ChatGPT correctly recognizes two of the resolutions mentioned by name, but the remaining bullets simply describe the discussion, rather than reference specific bills.

Prompt: 

Make a bulleted list of all of the congressional bills and resolutions mentioned in the transcript: " DEMOCRATS, ON THE OTHER HAND, WE WANT COMPREHENSIVE IMMIGRATION REFORM. WE ARE READY, WE ARE WILLING, WE ARE ABLE TO WORK WITH ANYONE WHO SERIOUSLY WANTS TO GET SOMETHING DONE. IT'S TIME FOR OUR COLLEAGUES ACROSS THE AISLE TO JOIN US IN THIS EFFORT. THESE BILLS TODAY ARE JUST THE START. MY HOPE IS THAT WE ARE ABLE TO MAKE MORE PROGRESS ON THIS FRONT BEFORE THE END OF THE YEAR. MR. SPEAKER, I URGE ALL MY COLLEAGUES TO SUPPORT THIS RULE. I RESERVE THE BALANCE OF MY TIME. THE SPEAKER PRO TEMPORE: THE GENTLEMAN FROM MASSACHUSETTS RESERVES. THE GENTLEWOMAN FROM MINNESOTA IS RECOGNIZED. MRS. FISCHBACH: THANK YOU, MR. SPEAKER. I THANK THE REPRESENTATIVE FROM MASSACHUSETTS FOR YIELDING ME THE CUSTOMARY 30 MINUTES. AND I YIELD MYSELF SUCH TIME AS I MAY CONSUME. . TODAY WE'RE HERE TO DISCUSS H.R. 3648, THE EAGLE ACT, AND H.R. 7946, THE VETERAN SERVICES RECOGNITION ACT. THE EAGLE ACT WOULD DO AWAY WITH COUNTRY CAPS FOR CERTAIN EMPLOYMENT-BASED GREEN CARDS. UNFORTUNATELY, THE BILL WE ARE DEBATING TODAY CHANGES A CAREFULLY NEGOTIATED AND GREED UPON BILL FROM LAST CONGRESS. FAVORING A DEMOCRAT GO IT ALONE APPROACH THAT UNFORTUNATELY WE'VE SEEN ALL TOO OFTEN IN THIS BODY OVER THE LAST TWO YEARS. ONE OF THE MOST SHOCKING CHANGES IS THE EXCLUSION OF CRITICAL LANGUAGE TO PREVENT THOSE ASSOCIATED WITH THE CHINESE COMMUNIST PARTY, OR THE CHINESE ARMED FORCES, FROM ADMISSION TO THESE IMMIGRATION PROGRAMS. WHEN THIS CAME THROUGH THE JUDICIARY COMMITTEE CONGRESSMAN BISHOP OFFERED AN AMENDMENT TO ADD LANGUAGE THAT ONCE AGAIN CLARIFIED THAT C.C.P. MEMBERS ARE INELIGIBLE TO PARTICIPATE IN THESE PROGRAMS. THAT AMENDMENT FAILED ON A PARTY LINE VOTE. WE ALL KNOW THE C.C.P. IS NOT A GOOD-FAITH ACTOR, AND I AM APPALLED THAT THE MAJORITY WOULD RISK OUR NATIONAL SECURITY BY REJECTING THAT AMENDMENT. H.R. 7946, THE VETERAN SERVICES RECOG RECOGNITION ACT, AIMS TO ESTABLISH A PROGRAM FROM THE D.H.S. FOR NONCITIZENS TO RECEIVE CITIZENSHIP THROUGH SERVICE IN THE MILITARY. BASED ON THE TITLE IT SOUNDS LIKE A GOOD BILL. OF COURSE, THOSE WHO SERVED HONORABLY IN THE ARMED FORCES SHOULD BE HONORED FOR THEIR VALOR AND SACRIFICE. BUT DESPITE THE TITLE, THIS BILL DID NOT EVEN GO THROUGH THE VETERANS' AFFAIRS COMMITTEE."

ChatGPT:

Bills and resolutions mentioned in the transcript are:

Here ChatGPT gets two of the mentions correct – H.R. 3648 and 7946, but hallucinates mentions of the other two (H.R. 6 and H.R. 1603). H.R. 1603 is a real bill whose title is "Farm Workforce Modernization Act" and H.R. 6 is similarly a real bill that was named "American Dream and Promise Act" but neither were mentioned in the passage above (though they were alluded two in the prior passage, but not by name). Importantly, both were 2021 bills, which is the cutoff year for ChatGPT's training data, suggesting this is likely due to the most similar bills in its knowledgebase being from that year – its most recent. Interestingly, ChatGPT's inclusion of H.R. 6 appears to be due to the mention of "dreamers" in the prior passage, while H.R. 1603 seems to relate to the discussion of farm workers in the prior passage. In this case, neither bill was explicitly mentioned and certainly not in the passage in question, but both are peripherally related, since this passage follows from the prior one, which invokes in passing, but does not mention them.

Prompt: 

Make a bulleted list of all of the congressional bills and resolutions mentioned in the transcript: " WHY? BECAUSE IT IS JUST ONE MORE EXAMPLE OF THE DEMOCRATS' EXPLOITING A SYMPATHETIC POPULATION TO PUSH THEIR OPEN BORDER POLICIES AND THEY SHOULD BE ASHAMED. I WILL ALSO POINT OUT THAT THERE ARE ALREADY PROCEDURES IN PLACE BY WHICH NONCITIZEN SERVICE MEMBERS CAN BE REWARDED FOR THEIR SACRIFICES FOR THIS COUNTRY. THERE ARE SPECIAL AVENUES TO NATURALIZE MEMBERS OR VETERANS IN THE U.S. MILITARY. THESE PROCEDURES HAVE BEEN IN PLACE SINCE 2002. UNDER THE CURRENT I.N.A., IT RIGHTFULLY DOES NOT OFFER THIS OPPORTUNITY TO THOSE WHO ARE DISHONORABLY DISCHARGED OR THOSE WHO HAVE COMMITTED A SERIOUS CRIME. BUT THE BILL WE ARE DISCUSSING TO TODAY, EITHER THROUGH POOR DRAFTING OR PURPOSEFUL VAGUENESS, DOES OFFER A CITIZENSHIP TO THOSE PEOPLE. IN THE JUDICIARY COMMITTEE, SEVERAL AMENDMENTS WERE OFFERED TO ENSURE DANGEROUS CRIMINALS DID NOT RECEIVE AN ADJUSTMENT OF IMMIGRATION STATUS. AMENDMENTS THAT INCLUDED CRIMES LIKE ILLICIT TRAFFICKING IN FIREARMS, HUMAN TRAFFICKING, AND EACH AMENDMENT FAILED. WHY ARE MY COLLEAGUES ACROSS THE AISLE SO EAGER TO HAVE CRIMINALS ON THE STREETS OF OUR COMMUNITIES? THIS BILL DOESN'T EVEN APPLY TO JUST VETERANS. IT WOULD EXPAND PROTECTIONS FOR NONCITIZEN FAMILIES — FAMILY MEMBERS OF VETERANS WHO WOULD OTHERWISE BE DEPORTED FOR COMMITTING CRIMES. HUMAN SMUGGLERS, DOMESTIC ABUSERS, THOSE THAT DID NOT SERVE IN OUR ARMED FORCES, WOULD AVOID DEPORTATION BECAUSE OF THIS BILL. THIS BILL RELIES HEAVILY ON THE INTERPRETATION OF THE SECRETARY OF HOMELAND SECURITY. AS IT IS WRITTEN, D.H.S. DOES NOT HAVE TO DEPORT ANYONE. LEAVING IT TO THE D.H.S. SECRETARY TO EXERCISE DISCRETION IN ALMOST ALL CASES. SECRETARY MAYORKAS HAS DONE NOTHING TO EASE THE IMMIGRATION CRISIS IN THIS COUNTRY. DO WE REALLY WANT TO GIVE SOMEONE LIKE THAT MORE RESPONSIBILITY? I AM SKEPTICAL THAT AN INDIVIDUAL WHO CAN'T EVEN ADMIT THAT THE BORDER IS NOT SECURE WILL TREAT THIS INCREASED DISCRETION IN A MANNER THAT IS REQUIRED TO KEEP OUR COMMUNITIES SAFE. BEFORE I RESERVE, I WILL NOTE THAT THE RULE BEFORE US PROVIDES NO REPUBLICAN AMENDMENTS IN ORDER, CONTINUING A TREND BY THIS MAJORITY OF STIFLING DEBATE AND SUPPRESSING THE MINORITY PARTY'S OPPORTUNITY TO OFFER CHANGES OR IDEAS TO IMPROVE THE UNDERLYING BILLS. THANK YOU, MR. SPEAKER, AND IT'S FOR THAT REASON I OPPOSE THE RULE AND I ASK MEMBERS TO DO THE SAME AND I RESERVE. THE SPEAKER PRO TEMPORE: THE GENTLEWOMAN FROM MINNESOTA RESERVES. THE GENTLEMAN FROM MASSACHUSETTS IS RECOGNIZED. MR. MCGOVERN: WELL, THANK YOU VERY MUCH, MR. SPEAKER. AND LET ME JUST SAY THAT — AND HERE'S THE PROBLEM. WE JUST HEARD FROM MY COLLEAGUE FROM MINNESOTA. REPUBLICANS ARE MORE INTERESTED IN GIMMICKY AMENDMENTS AND SOUND BITES AS A WAY TO TRY TO GET PEOPLE TO DO NOTHING. I MEAN, THEY ARE THE PARTY OF NO WHEN IT COMES TO IMMIGRATION. MY COLLEAGUE SAYS SOMEHOW THAT THE DEMOCRATS ARE BLOCKING ATTEMPTS TO BAN PEOPLE ASSOCIATED WITH COMMUNIST OR TOTALITARIAN PARTIES — SOMEHOW WE WANT TO ADMIT THEM IN THIS COUNTRY. HERE'S THE REALITY AND THIS IS THE FACT AND PEOPLE CAN CHECK THIS. CURRENT LAW SAYS — CURRENT LAW, INDIVIDUALS ASSOCIATED WITH A COMMUNIST OR TOTALITARIAN PARTY ARE INADMISSIBLE UNDER THE IMMIGRATION AND NATIONALITY ACT. THAT'S THE CURRENT LAW. SO AT SOME POINT MAYBE MY FRIENDS ON THE OTHER SIDE WOULD WANT TO HELP FIX THE IMMIGRATION SYSTEM RATHER THAN JUST DEMAGOGUE THE ISSUE OVER AND OVER AND OVER AGAIN. THIS IS AN ISSUE, BY THE WAY, THAT IS IMPORTANT TO OUR ECONOMIC WELL-BEING. OUR BUSINESS COMMUNITY WANTS THESE BILLS PASSED IN PART BECAUSE THEY'RE HAVING A TOUGH TIME TRYING TO FILL CURRENTSO W AND IF THAT'S WHAT YOU WANT TO DO, FINE. OR YOU CAN ACTUALLY LEGISLATE AND GET SOMETHING DONE. AND WITH THAT I RESERVE MY TIME. THE SPEAKER PRO TEMPORE: THE GENTLEMAN FROM MASSACHUSETTS RESERVES."

ChatGPT:

Here ChatGPT describes discussion around a proposed bill, rather than correctly stating that no bill is mentioned by name, as per the prompt. However, it does correctly recognize that the acronym "I.N.A." mentioned in the text refers to the Immigration and Nationality Act, showing its ability to recognize, disambiguate and resolve acronyms in context.

Prompt: 

Make a bulleted list of all of the congressional bills and resolutions mentioned in the transcript: " THE GENTLEWOMAN FROM MINNESOTA IS RECOGNIZED. MRS. FISCHBACH: THANK YOU, MR. SPEAKER. AND I JUST WANT TO COMMENT ON THE SO-CALLED GIMMICKY AMENDMENTS. I DON'T SEE IT GIMMICKY WHEN WE ARE TRYING TO STOP CRIMINALS FROM STAYING IN OUR COUNTRY. I DON'T SEE IT AS GIMMICKY WHEN WE ARE TRYING TO STOP HUMAN TRAFFICKERS. I DON'T SEE IT AS GIMMICKY WHEN WE ARE TRYING TO STOP THOSE WHO HAVE TRAFFICKED GUNS, FIREARMS. I DON'T SEE THAT AS GIMMICKY. I SEE THAT AS TRYING TO PROTECT THE PEOPLE OF THE COUNTRY. AND MAKING SURE WE DO NOT ALLOW CRIMINALS TO CONTINUE TO STAY IN OUR COUNTRY. AND AS FOR THE ISSUE OF CURRENT LAW, IF IT IS THE CASE THAT THOSE ASSOCIATED WITH THE C.C.P. ARE ALREADY NOT ALLOWED UNDER CURRENT LAW, THEN THERE IS NO ISSUE TO JUST PUT IT — PUT THIS IN THE BILL JUST IN CASE AND MAKING SURE WE HAVE SATISFIED THE CONCERNS OF PEOPLE WHO ARE CONCERNED ABOUT ALLOWING THOSE MEMBERS — THOSE C.C.P. MEMBERS INTO THE COUNTRY. WITH THAT I RESERVE. THE SPEAKER PRO TEMPORE: THE GENTLEWOMAN FROM MINNESOTA RESERVES. THE GENTLEMAN FROM MASSACHUSETTS IS RECOGNIZED. MR. MCGOVERN: AGAIN, ON TRAFFICKERS AND GUN SMUGGLERS AND YOU NAME IT, THOSE THINGS ARE ALREADY ILLEGAL. BUT WHATEVER. IT'S NOT WORTH GETTING INTO IT. I WILL RESERVE MY TIME AND WE HAVE NO OTHER SPEAKERS ON OTHER SIDE. THE SPEAKER PRO TEMPORE: THE GENTLEMAN RESERVES. THE GENTLEWOMAN FROM MINNESOTA IS RECOGNIZED. MRS. FISCHBACH: MR. SPEAKER, I AM PREPARED TO CLOSE. THE SPEAKER PRO TEMPORE: THE GENTLEWOMAN IS RECOGNIZED. MRS. FISCHBACH: THANK YOU, MR. SPEAKER. THIS MAJORITY ALL TOO OFTEN USES FLOWERY TITLES TO MASK THE BILLS' TRUE MEANING. THE VETERANS SERVICE RECOGNITION ACT IS ANOTHER EXAMPLE. IT LEADS THE PUBLIC TO BELIEVE THAT WE WOULD RECOGNIZE THE SERVICE OF OUR VETERANS BUT ONCE AGAIN YOU TAKE A CLOSER LOOK, IT BECOMES PAINFULLY CLEAR THAT THIS IS ANOTHER PUSH FOR OPEN BORDERS. THIS BILL INTENDS TO PAVE A FAR BROADER PATHWAY TO CITIZENSHIP. NOT JUST FOR VETERANS. A PATH ALREADY EXISTS FOR VETERANS SINCE 2002. BUT THIS BILL OPENS A PATH TO CRIMINALS, SOMETHING DEMOCRATS REJECTED EVERY OPPORTUNITY THEY HAD TO KEEP CRIMINALS OUT OF THE PROGRAM. IN JUST TWO SHORT YEARS, THE AMERICAN PEOPLE HAVE WATCHED AS THE SITUATION AT THE SOUTHERN BORDER HAS DETERIORATED INTO NOTHING SHORT OF A CRISIS. I WOULD HAVE HOPED THAT MY COLLEAGUES WOULD TREAT THIS SITUATION A LITTLE MORE SERIOUSLY. BUT UNFORTUNATELY, I'VE COME TO EXPECT NOTHING LESS. THIS BILL IS JUST ONE MORE EXAMPLE OF HOW DEEPLY UNSERIOUS MY COLLEAGUES IN THE MAJORITY ARE OF ADDRESSING THE DISASTER AT OUR SOUTHERN BORDER. I OPPOSE THIS BILL AND I ASK MEMBERS TO DO THE SAME. THANK YOU, MR. SPEAKER. AND I YIELD BACK. THE SPEAKER PRO TEMPORE: THE GENTLEWOMAN YIELDS BACK. THE GENTLEMAN FROM MASSACHUSETTS IS RECOGNIZED. MR. MCGOVERN: MR. SPEAKER, LET ME REMIND ALL MY COLLEAGUES THAT THE VETERAN SERVICE RECOGNITION ACT IS ACTUALLY SUPPORTED BY THE AMERICAN LEGION. ONE OF OUR LEADING VETERAN ORGANIZATIONS IN THIS COUNTRY. BUT I GUESS THAT'S NOT ENOUGH FOR SOME OF MY REPUBLICAN COLLEAGUES, AGAIN, SAYING NO TO EVERYTHING. MR. SPEAKER, THE EAGLE ACT AND THE VETERAN SERVICE RECOGNITION ACT PROVIDE NECESSARY REFORMS THAT WILL IMPROVE OUR IMMIGRATION SYSTEM. I KNOW SO MUCH MORE CAN BE DONE. AS I SAID BEFORE, WE NEED TO DO MORE, BUT THESE BILLS ARE SMALL STEPS WE CAN DO NOW TO CLEAR BACKLOGS AND ENSURE THOSE WHO HAVE NOT ONLY PLAYED BY THE RULES BUT SACRIFICED IN THE SERVICE OF OUR NATION CAN BECOME CITIZENS. THEY ARE IMPORTANT POLICIES THAT SHOULD BECOME LAW. YOU KNOW, I READ TODAY THAT SOME OF MY FRIENDS ON THE OTHER SIDE OF THE AISLE ARE URGING THEIR NEXT LEADER — I DON'T KNOW WHO IT WILL BE — TO USE THE DEBT CEILING NOT ONLY TO CUT SOCIAL SECURITY AND MEDICARE AND A WHOLE BUNCH OF OTHER PROGRAMS THAT ARE VITAL, INCLUDING NUTRITION PROGRAMS, BUT THEY WANT TO USE IT AS LEVERAGE TO GO AFTER IMMIGRANTS, TO MESS UP OUR IMMIGRATION SYSTEM EVEN MORE. WHAT A ROTTEN WAY TO LEGISLATE, TO USE THE DEBT CEILING AS AN EXCUSE TO TRY TO DERAIL GOVERNMENT."

ChatGPT:

The congressional bills and resolutions mentioned in the transcript are:

Both of these acts are mentioned in the text, but notably they are mentioned by name, rather than bill number.

Prompt: 

Make a bulleted list of all of the congressional bills and resolutions mentioned in the transcript: " WE ALREADY KNOW WHAT THE REPUBLICANS ARE CAPABLE OF DOING. THE LAST TIME THEY WERE IN CHARGE OF THE HOUSE AND SENATE AND THE WHITE HOUSE, THEY SHUT THE GOVERNMENT DOWN AND THEY LEFT. THAT'S THEIR IDEA OF RESPONSIBLE GOVERNING. WELL, WE SHOULDN'T BE USING THE DEBT CEILING AS LEVERAGE. WE SHOULD BE — WE SHOULD ACTUALLY BE PAYING OUR BILLS THAT WE ACCUMULATED. IF YOU DON'T LIKE THE SPENDING, I DIDN'T LIKE DONALD TRUMP'S TAX CUT THAT BENEFITED MOSTLY WEALTHY PEOPLE IN THIS COUNTRY, I NONETHELESS VOTED TO INCREASE THE DEBT CEILING BECAUSE WE HAD ACCUMULATED ALL OF THAT DEBT BECAUSE OF THAT TERRIBLE TAX CUT GEARED TOWARD THE RICH. IT'S THE RESPONSIBLE THING TO DO. AND SO IT REALLY IS KIND OF DISTURBING TO HEAR SOME OF THE PRIORITIES OF MY REPUBLICAN FRIENDS. AND LOOK, ON IMMIGRATION, AS I SAID BEFORE, THEIR POLICY ON IMMIGRATION HAS BEEN CONSISTENT. DEMAGOGUE, DEMAGOGUE, DEMAGOGUE. FIX NOTHING. THEY BLAME IMMIGRANTS FOR NOTHING. IT'S RAINING OUTSIDE. IT IS IMMIGRANTS. A FIGHT WITH THEIR SPOUSE, IT MUST BE THE FAULT OF IMMIGRANTS. THAT'S THEIR M.O. THAT'S WHAT THEY HAVE DONE. AND IT REALLY IS OFFENSIVE. AND IT BETRAYS KIND OF THE HIGHEST VALUES OF THIS COUNTRY. YOU KNOW, THE TWO BILLS BEFORE US ARE MODEST. THERE'S MUCH MORE WE NEED TO DO. WE NEED TO HELP THE DREAMERS. WE NEED TO FIX THE ISSUE FOR OUR T.P.S. HOLDERS. WE OWE THAT TO THEM. SO ANYWAY, LET ME CLOSE BY SAYING WE ARE GOING TO SPEND THE NEXT FEW WEEKS LEGISLATING AND DELIVERING FOR THE AMERICAN PEOPLE. AND I WOULD URGE SOME OF MY COLLEAGUES TO JOIN WITH US IN GETTING THINGS DONE OR THEY CAN SIMPLY DO WHAT THEY USUALLY DO AND COMPLAIN AND COMPLAIN AND DEMAGOGUE AND DEMAGOGUE. SO WITH THAT, MR. SPEAKER, I WOULD URGE A YES VOTE ON THE RULE AND ON THE PREVIOUS QUESTION AND I YIELD BACK THE BALANCE OF MY TIME AND I MOVE THE PREVIOUS QUESTION ON THE RESOLUTION. THE SPEAKER PRO TEMPORE: THE GENTLEMAN FROM MASSACHUSETTS RESERVES — YIELDS BACK. WITHOUT OBJECTION, THE PREVIOUS QUESTION IS ORDERED. THE QUESTION IS ON THE ADOPTION OF THE RESOLUTION. ALL THOSE IN FAVOR SAY AYE. THOSE OPPOSED, NO. THE AYES HAVE IT. THE RESOLUTION IS — THE GENTLEWOMAN FROM MINNESOTA IS RECOGNIZED. MRS. FISCHBACH: MR. SPEAKER, I WOULD REQUEST THE YEAS AND NAYS. THE SPEAKER PRO TEMPORE: THE YEAS AND NAYS ARE REQUESTED. THOSE FAVORING A VOTE BY THE YEAS AND NAYS WILL RISE. A SUFFICIENT NUMBER HAVING ARISEN, THE YEAS AND NAYS ARE ORDERED. PURSUANT TO CLAUSE 8 OF RULE 20, FURTHER PROCEEDINGS ON THIS QUESTION WILL BE POSTPONED. PURSUANT TO CLAUSE 12-A OF RULE 1, THE CHAIR DECLARES THE HOUSE IN RECESS SUBJECT TO THE CALL OF THE CHAIR. ANNOUNCER: COMING UP, A CONGRESSIONAL GOLD MEDAL CEREMONY HONORING CAPITOL POLICE, THE D.C. METROPOLITAN POLICE AND OTHERS THAT PROTECTED THE CAPITOL ON JANUARY 6. WATCH LIVE COVERAGE THIS MORNING AT 11:00 A.M. EASTERN ON C-SPAN, C-SPAN NOW, OR ONLINE AT C-SPAN.ORG. ANNOUNCER: C-SPAN IS YOUR UNFILTERED VIEW OF GOVERNMENT. WE ARE FUNDED BY THESE TELEVISION COMPANIES AND MORE, INCLUDING COMCAST. >> YOU THINK THIS IS JUST A COMMUNITY CENTER? IT IS MORE THAN THAT. >> COMCAST IS"

ChatGPT:

No specific bills or resolutions are mentioned in the transcript.

While ChatGPT earlier linked a reference to "dreams" to a specific resolution, here it does not.

Overall, ChatGPT performed extremely well at recognizing the three pieces of legislation mentioned in the transcription, but it also hallucinated two mentions of acts that were not mentioned explicitly in the text (they were alluded to in an earlier passage, but not mentioned specifically and were not present in the text they were tagged in and it did not flag subsequent mentions) and, most problematically, took two real bills that were not mentioned in any form in the text and combined them together in a hallucinated false bill. Thus, with three correctly identified pieces of legislation and three incorrectly identified ones, ChatGPT's accuracy rate on this text is extremely poor – below the level at which a simpler grammar-based extractor would perform.

 

This analysis is part of an ongoing collaboration between the Internet Archive and its TV News Archive, the multi-party Media-Data Research Consortium and GDELT.