The GDELT Project

Upgrading The VGEGV2 File Listing Format

As the number of broadcasts in the Visual Global Entity Graph 2.0 continues to rapidly grow, it is becoming increasingly cumbersome to use a single text file to record the complete master list of all broadcasts. To address this, we will be converting the VGEGV2 file list from a single master file to daily files, in which each day has its own listing file for shows from that day. This will make the file lists process far more scalable as this collection continues to grow and will bring it in line with our other datasets like our ngrams, which all use this new format.