Creating A Planetary Scale Open Dataset: Just How Big Is GDELT?

The GDELT Project encompasses an incredible array of datasets spanning the entire planet, reaching across 65 languages and making sense of modalities from text to images to video. This enormous realtime open firehose of data cataloging planet earth is available as downloadable files in Google Cloud Storage, JSON APIs for powering web interfaces, and for […]

GDELT At Google Cloud NEXT 2018

GDELT makes two appearances at Google Cloud NEXT next week! Sergei Sokolenko, Product Manager Google Cloud and Nick Caldwell VP of Engineering for Reddit will be presenting "Predicting Community Engagement on Reddit using Tensorflow, GDELT and Cloud Dataflow" in room DA205 on Tues, July 24th from 4:35-5:25PM. Anand Autar, Head of Portfolio Risk Management at […]

The New Yorker: Are Things Getting Better or Worse?

An article in the July 23rd issue of The New Yorker talks about how we understand and assess the world around us and mentions Steven Pinker's inclusion in his new book of the famous Culturomics 2.0 graph showing global news media becoming steadily more negative over the past quarter century. Read The Full Article.

GDELT 3.0: GEN 3 Crawlers & Document Extraction Infrastructure

We're incredibly excited to announce today that over the past 24 hours GDELT's entire fleet of front line article crawlers have been upgraded to a transitional version of the forthcoming GDELT 3.0 (GEN 3) crawling infrastructure. For the moment we've only upgraded the crawlers themselves, leaving the GEN 2 backend queuing, dispatching and horizon management […]

Watching The Media Wake Up In The Morning Through Crawler CPU Graphs

The global media has a definitive circadian rhythm of its own, with the total journalistic output of each country following fairly consistent local daylight working hours. This rhythm can be measured in many ways, most simply of which is the total number of new articles published every 15 minutes. Yet it is also fascinating to […]

Could The Verizon Location Data Sale Have Compromised US Spy Networks?

Verizon’s resale of its customer location data poses not just a threat to the privacy of ordinary citizens, but in the hands of foreign powers could have jeopardized national security, raising the question of just how much other dangerous data is being bought and sold at this very moment. Read The Full Article.

Should Social Media Ban Profanity And Name Calling?

Social media is the elusive elixir turning us from Dr. Jekyll to Mr. Hyde, but perhaps those same companies can finally provide us the antidote as well, using technology to nudge us away from our dark infantile tantrums and evil personas back towards the light of enlightenment and reason. Read The Full Article.

Why Do We Keep Blaming AI For Society's Ethical Concerns?

AI has increasingly become a catch-all scapegoat for the ethical conundrums of society, but the reality is that it is parallel technological advances from drones to big data that are the real drivers and the most important question to ask is if AI was replaced with a human would it still be scary? Read The […]

Could Google Image Search Help Fight Fake News On Social Media?

Could we fight fake news by reconnecting shared images to their origins, using automatic reverse image search to add context to all imagery that summarizes it based on how it has been captioned across the web and offering links to places it has been seen in the past? Read The Full Article.

Could AI Help Reform Academic Publishing?

Filled with explosive growth in available knowledge, widespread citation errors and increasing use of datasets and methods outside their traditional disciplines, automated prereview from simple statistical review to deep learning processing of papers could help reform academic publishing. Read The Full Article.