The GDELT Project

Daily Updates To 'Master List Of Social Media In The News' In CSV And BigQuery

We are excited to announce that the 2016-2019 social media outlink dataset is now being updated daily! Every morning just after 4AM UTC you can download the latest file in the format "http://data.gdeltproject.org/gdeltv3/gkg/sociallinks/YYYYMMDD.sociallinks.txt.gz" starting with "20190908.sociallinks.txt.gz" where the date will always be the previous day and contain all of the Facebook, Instagram, QQ, Twitter, Vimeo, VK and YouTube links found in worldwide news that day.

To download the data on a daily basis, just fetch that URL each day around 4AM UTC with the previous day's date. The format is identical to the historical outlink dataset. There is also a FILELIST.TXT file that lists all of the available daily update files (the daily files begin with 9/8/2019).

The BigQuery version of the table "gdelt-bq.gdeltv2.gkg_socialoutlinks" is also updated each day at the same time.