The GDELT Project encompasses an incredible array of datasets spanning the entire planet, reaching across 65 languages and making sense of modalities from text to images to video. This enormous realtime open firehose of data cataloging planet earth is available as downloadable files in Google Cloud Storage, JSON APIs for powering web interfaces, and for […]
Since the launch of GDELT's Global Frontpage Graph (GFG) on March 2nd of this year, the dataset has rapidly evolved into one of the world's largest open data URL datasets and the largest catalog ever created of the hourly editorial decisions of the world's news outlets across the planet. To get a sense of just […]
GDELT makes two appearances at Google Cloud NEXT next week! Sergei Sokolenko, Product Manager Google Cloud and Nick Caldwell VP of Engineering for Reddit will be presenting "Predicting Community Engagement on Reddit using Tensorflow, GDELT and Cloud Dataflow" in room DA205 on Tues, July 24th from 4:35-5:25PM. Anand Autar, Head of Portfolio Risk Management at […]
An article in the July 23rd issue of The New Yorker talks about how we understand and assess the world around us and mentions Steven Pinker's inclusion in his new book of the famous Culturomics 2.0 graph showing global news media becoming steadily more negative over the past quarter century. Read The Full Article.
We're incredibly excited to announce today that over the past 24 hours GDELT's entire fleet of front line article crawlers have been upgraded to a transitional version of the forthcoming GDELT 3.0 (GEN 3) crawling infrastructure. For the moment we've only upgraded the crawlers themselves, leaving the GEN 2 backend queuing, dispatching and horizon management […]
BBVA's latest report offers a fascinating glimpse of the global discussion of global trade support, including a number of innovative visualizations! Read The Full Report.
The global media has a definitive circadian rhythm of its own, with the total journalistic output of each country following fairly consistent local daylight working hours. This rhythm can be measured in many ways, most simply of which is the total number of new articles published every 15 minutes. Yet it is also fascinating to […]
Vox' Alvin Chang explores how the networks contextualized family separation at the border. Read The Full Article.
As computational methods continue to infuse across the scholarly disciplines, academic publishers will face increasing calls to permit text and data mining of their holdings, with subscription research clouds offering perhaps the best and most secure model for enabling this brave new future. Read The Full Article.
Verizon teaches us that in today’s surveillance society, purchasing a product no longer protects you from becoming a product yourself and the concept of “buying” privacy and the right to not be surveilled is now merely a quaint notion from a bygone day. Read The Full Article.
Verizon’s resale of its customer location data poses not just a threat to the privacy of ordinary citizens, but in the hands of foreign powers could have jeopardized national security, raising the question of just how much other dangerous data is being bought and sold at this very moment. Read The Full Article.
Verizon's resale of its customer location data reminds us that in our surveillance society there is no way to escape being bought and sold – if its free, you’re paying for it by being turned into data, but even if you’re paying for it, you’re still probably being resold, but paying for the privilege. Read […]
AI is rapidly reaching a point where the creation of nearly flawless artificial imagery and video will be within the reach of anyone with a smartphone – to restore trust in such an environment, social media companies must return to the concept of context and provenance. Read The Full Article.
The era of "big data" is upending not just industry itself, but the traditional balance between applied and basic research and the role academia plays in advancing research, raising the question of how everything from academic publishing to granting agencies like NSF will evolve. Read The Full Article.
The Cambridge Analytica scandal has changed little in Facebook's approach to user privacy and transparency in how it uses the data that its two billion members entrust it with and the company's latest argument that third parties are extensions of itself may confound attempts for more control. Read The Full Article.
Social media is the elusive elixir turning us from Dr. Jekyll to Mr. Hyde, but perhaps those same companies can finally provide us the antidote as well, using technology to nudge us away from our dark infantile tantrums and evil personas back towards the light of enlightenment and reason. Read The Full Article.
The US Government's growing move to the commercial cloud could dramatically improve its cybersecurity posture, reduce unauthorized leaking and lead to a modern security-first data culture. Read The Full Article.
AI has increasingly become a catch-all scapegoat for the ethical conundrums of society, but the reality is that it is parallel technological advances from drones to big data that are the real drivers and the most important question to ask is if AI was replaced with a human would it still be scary? Read The […]
Facebook has bet the company on the success of its AI filtering algorithms and portrays them as a huge success, but refuses to offer any detail into how often they are wrong and whether they are wrong more often than they are right. Read The Full Article.
Social media’s fixation on realtime and short context-free communications that reward meme-worthy virality over informed conversation and deep understanding is reshaping our society to emphasize the what over the why. Read The Full Article.
Throughout the year Facebook has been polling its users about its roll in the world, but does the survey’s design suggest the company doesn’t really care about the answer? Read The Full Article.
The Washington Post's Philip Bump explores how media coverage of several major topics evolved across the networks in the leadup to the 2016 US presidential election. Read The Full Article.
Could we fight fake news by reconnecting shared images to their origins, using automatic reverse image search to add context to all imagery that summarizes it based on how it has been captioned across the web and offering links to places it has been seen in the past? Read The Full Article.
Filled with explosive growth in available knowledge, widespread citation errors and increasing use of datasets and methods outside their traditional disciplines, automated prereview from simple statistical review to deep learning processing of papers could help reform academic publishing. Read The Full Article.