Continue Reading

The Top Entities By Day Using BigQuery And The Cloud Natural Language API Through The GEG

The GDELT Global Entity Graph (GEG) dataset of 11 billion entities extracted by Google's Cloud Natural Language API from 103…

Continue Reading

Querying The New Global Entity Graph (GEG) Datasets In BigQuery: Example Queries

Both the neural GEG (based on Google's Cloud Natural Language API) and classical GEG (based on a traditional HMM POS…

Continue Reading

Charting Global English-Language Media Anxiety Through The News: BigQuery + WEB NGrams

Using the new Web News Ngram (WEB-NGRAM) dataset, it takes just a single line of SQL and Google BigQuery to…

Continue Reading

Web News Ngram Datasets (WEB-NGRAM) Now Available In BigQuery

The new Web News Ngram datasets are now available in Google's BigQuery platform, updated every 15 minutes and stretching back…

Continue Reading

Daily Updates To 'Master List Of Social Media In The News' In CSV And BigQuery

We are excited to announce that the 2016-2019 social media outlink dataset is now being updated daily! Every morning just…

Continue Reading

Television News Ngram Datasets (TV-NGRAM) Now Available In BigQuery

The Television News Ngram datasets are now available in Google's BigQuery platform, updated every morning, making it possible to perform…

Continue Reading

Television News Inventory Files Now Available In BigQuery

The Television News inventory files are now available in Google's BigQuery platform, updated every morning, making it possible to perform…

Continue Reading

Charting The Emotions Of Television News: BigQuery + TV NGrams

The new Television News Ngram Datasets make an incredible range of new analyses possible. With just a single line of…

Continue Reading

The Top Daily Terms By Station On American Television 2009-2019 Using BigQuery And TV Ngrams

Converting piles of unstructured text into structured tables like ngrams opens the door to all kinds of powerful new analyses…

Continue Reading

Computing TF-IDF Scores From The TV Ngram Dataset In BigQuery

The ever-amazing Felipe Hoffa came up with the following BigQuery query that computes the TF-IDF scores for the new Television…

Continue Reading

Google's AutoML And BigQuery ML: The Rise Of One-Click Hyperscale Machine Learning

The cloud is no longer just a place where AI experts go to pioneer the future or scarce deep learning…

Continue Reading

Using BigQuery As A Lens To Explore Large Datasets

One of the most incredible aspects of the modern cloud is the way in which it accelerates massive adhoc data…

Continue Reading

Google's BigQuery Brings GIS Into The Petascale Era

BigQuery’s unique ability to couple petascale query infrastructure with thousands or even tens of thousands of cores and apply it…

Continue Reading

Merging Billions of URLS Using BigQuery

One of the most amazing things about Google's BigQuery service is its nearly infinite scalability and the sheer speed at…

Continue Reading

Using BigQuery To Make A 38 Year Timeline Of World Conflict From Half A Billion Records In 3 Seconds

Three years ago we showed off the results of a singularly incredible BigQuery query, courtesy of the one and only…

Continue Reading

A First Look At Three Weeks Of The Global Frontpage Graph (GFG) Through BigQuery

The newest addition to the GDELT family, the GDELT 3.0 Global Frontpage Graph (GFG) has been running every hour for…

Continue Reading

Building dictionaries for Word Encodings using BigQuery SQL

Google's Sergei Sokolenko demonstrates how to convert the GKG's themes, names and locations fields into a numeric BOW vector suitable…

Continue Reading

Big Data at BBVA Research using GDELT+BigQuery

Tomasa Rodrigo Lopez from BBVA Research presented at Google Next Madrid this past June 8th on how they are using…

Continue Reading

VGKG 2.0 Now Available In Partitioned BigQuery Table

As the GDELT Visual Global Knowledge Graph (VGKG) has grown to just over 287 million images totaling 3.2TB of JSON…

Continue Reading

GDELT 3.0 And Using BigQuery And Streaming Google Cloud Storage For Logging

One of the most incredible aspects of working in Google's cloud environment is that no matter what you need, chances are…

Continue Reading

GDELT Featured In BigQuery + Excel Documentation Example

GDELT was used as an example in a tutorial on how to connect Bigquery to Excel on Google's Big Data…

Continue Reading

Connecting BigQuery To Microsoft Excel Using The New ODBC Driver

A new post by Tim Swast on the cloud big data and machine learning blog showcases a number of fascinating…

Continue Reading

Analysing World Events Using the GDELT dataset and Google BigQuery

Ali Niknejad of the Centre for Transport Studies at Imperial College London will be speaking at the Research Software Engineers…

Continue Reading

Announcing Partitioned GDELT BigQuery Tables

As GDELT has grown to truly extraordinary scale, the sheer magnitude of all of that data has made it increasingly…