This link has been bookmarked by 106 people . It was first bookmarked on 04 Aug 2006, by craig mcmillan.
-
23 Dec 15
-
25 Sep 15
-
04 Mar 14
carlos puentes"Here at Google Research we have been using word n-gram models for a variety of R&D projects, such as statistical machine translation, speech recognition, spelling correction, entity detection, information extraction, and others. While such models have usually been estimated from training corpora containing at most a few billion words, we have been harnessing the vast power of Google's datacenters and distributed processing infrastructure to process larger and larger training corpora. We found that there's no data like more data, and scaled up the size of our data by one order of magnitude, and then another, and then one more - resulting in a training corpus of one trillion words from public Web pages."
-
10 Mar 13
-
26 Feb 13
-
24 May 12
s. farooq razviword words literature frequence search Google_Books n-gram n-grams ngram ngrams Google Books Google google googleservice googlservices googletool googletools GoogleTool GoogleTools GoogleService GoogleServices "Google Ngram Viewer" Ngram Viewer chart charts google books statistics visualization tools graph graphs lab labs googlelabs interesting figures trends patterns book from phrases words stats analysis analyses feature features labs! lab! graphing graphs! tools! tool services! service tool! about on touse useful useful! central central!! hub!! Tool Tools tool!! tools!! tool!!!!!!! tools!!!!!!! ngram!! ngrams!! words!! words!!!!!!! language language!! writing writing!! trends trending trends!! measurement measurements measuring graphing!! graphs!! visualization!! literary literature!! literary!! fascinating! fascinating!! fascinating!!!! cool!!!! interesting!!!! frequency!! project projects statistics!! statistics!!!!!!! statistical analysis!! analyses!! charting reference!!!!!!!!!!
word words literature frequence search Google_Books n-gram n-grams ngrams google googlservices GoogleTool GoogleTools GoogleService GoogleServices Google Ngram Viewer Ngram Viewer chart charts books statistics visualization graph graphs lab labs googlelab
-
01 Apr 12
-
24 Feb 12
-
10 Feb 12
-
26 Jan 12
-
20 Jan 12
-
25 Aug 11
-
23 May 11
-
23 Jan 11
-
All Our N-gram are Belong to You
-
Here at Google Research we have been using word n-gram models for a variety of R&D projects, such as statistical machine translation, speech recognition, spelling correction, entity detection, information extraction, and others.
-
We found that there's no data like more data
-
It will advance the state of the art, it will focus research in the promising direction of large-scale, data-driven approaches, and it will allow all research groups, no matter how large or small their computing resources, to play together.
-
Can you please make this data available via BitTorrent?
-
Thank you Google. You are doing good things for the world.
-
The title of the post is a bit mis-leading: They do NOT belong to us, they belong, it seems, to LDC.
-
-
03 Jan 11
-
Here at Google Research we have been using word n-gram models for a variety of R&D projects, such as statistical machine translation, speech recognition, spelling correction, entity detection, information extraction, and others. While such models have usually been estimated from training corpora containing at most a few billion words, we have been harnessing the vast power of Google's datacenters and distributed processing infrastructure to process larger and larger training corpora. We found that there's no data like more data, and scaled up the size of our data by one order of magnitude, and then another, and then one more - resulting in a training corpus of one trillion words from public Web pages.
-
-
21 Dec 10
-
17 Dec 10
-
13 Dec 10
-
08 Dec 10
-
06 Oct 10
-
06 May 10
-
03 May 10
-
13 Oct 09
kavangoWe processed 1,024,908,267,229 words of running text and are publishing the counts for all 1,176,470,663 five-word sequences that appear at least 40 times. There are 13,588,391 unique words, after discarding words that appear less than 200 times.
-
02 Oct 09
-
12 Mar 09
-
18 Jan 09
-
06 Jan 09
-
27 Dec 08
-
06 Aug 08
-
08 Apr 08
-
02 Mar 08
David RobertsHere at Google Research we have been using word n-gram models for a variety of R&D projects, such as statistical machine translation, speech recognition, spelling correction, entity detection, information extraction, and others. While such models have usu
language database ai google research ngram linguistics dataset nlp
-
25 Jan 08
-
28 Dec 07
-
11 Dec 07
S JonesGoogle's $30 6 DVD dataset of 1,2,3,4 and 5 word n-grams found in 1TB of text w/ frequencies
-
13 Nov 07
-
02 Oct 07
-
22 Sep 07
-
22 Aug 07
-
07 Jun 07
-
12 Apr 07
-
09 Apr 07
-
08 Apr 07
-
03 Apr 07
-
02 Apr 07
-
22 Jan 07
-
14 Jan 07
Edward de LeauAll Our N-gram are Belong to You
-
04 Jan 07
-
28 Dec 06
-
25 Oct 06
-
27 Sep 06
Nick GallGoogle donates a huge corpus. n-grams come from statistical machine translation. They deal with sequences of words.
via_delicious_20101217 ImportedFurl20071006 google pinboardimport20141106 Language
-
Here at Google Research we have been using word n-gram models for a variety of R&D projects, such as statistical machine translation, speech recognition, spelling correction, entity detection, information extraction, and others. While such models have usually been estimated from training corpora containing at most a few billion words, we have been harnessing the vast power of Google's datacenters and distributed processing infrastructure to process larger and larger training corpora. We found that there's no data like more data, and scaled up the size of our data by one order of magnitude, and then another, and then one more - resulting in a training corpus of one trillion words from public Web pages.
-
-
15 Aug 06
-
14 Aug 06
-
07 Aug 06
-
05 Aug 06
-
04 Aug 06
-
Google to make available n-gram data from their 1 trillion-word training corpus.
google reseach information processing set ngrams corpus web searching
-
-
We believe that the entire research community can benefit from access to such massive amounts of data. It will advance the state of the art, it will focus research in the promising direction of large-scale, data-driven approaches, and it will allow all research groups, no matter how large or small their computing resources, to play together. That's why we decided to share this enormous dataset with everyone. We processed 1,011,582,453,213 words of running text and are publishing the counts for all 1,146,580,664 five-word sequences that appear at least 40 times. There are 13,653,070 unique words, after discarding words that appear less than 200 times.
Watch for an annnouncement at the LDC, who will be distributing it soon, and then order your set of 6 DVDs. And let us hear from you - we're excited to hear what you will do with the data, and we're always interested in feedback about this dataset, or other potential datasets that might be useful for the research community.
-
-
03 Aug 06
Page Comments
Would you like to comment?
Join Diigo for a free account, or sign in if you are already a member.