We are excited to announce that the 2016-2019 social media outlink dataset is now being updated daily! Every morning just after 4AM UTC you can download the latest file in the format "http://data.gdeltproject.org/gdeltv3/gkg/sociallinks/YYYYMMDD.sociallinks.txt.gz" starting with "20190908.sociallinks.txt.gz" where the date will always be the previous day and contain all of the Facebook, Instagram, QQ, Twitter, Vimeo, VK and YouTube links found in worldwide news that day.
To download the data on a daily basis, just fetch that URL each day around 4AM UTC with the previous day's date. The format is identical to the historical outlink dataset. There is also a FILELIST.TXT file that lists all of the available daily update files (the daily files begin with 9/8/2019).
The BigQuery version of the table "gdelt-bq.gdeltv2.gkg_socialoutlinks" is also updated each day at the same time.
- Daily File Format (change date to yesterday's date and fetch at 4AM UTC each morning): http://data.gdeltproject.org/gdeltv3/gkg/sociallinks/20190908.sociallinks.txt.gz
- Master File List Of Daily Update Files: http://data.gdeltproject.org/gdeltv3/gkg/sociallinks/FILELIST.TXT
- BigQuery Table: gdelt-bq.gdeltv2.gkg_socialoutlinks