This link has been bookmarked by 13 people . It was first bookmarked on 28 May 2008, by Paul Merrell.
-
26 Oct 10
-
26 Jan 10
-
24 Mar 09
-
This all adds up to terabytes of data, in a less-than-web-friendly format. So reusing the EC2/S3/Hadoop method I discussed back in November, I got to work writing a few lines of code. Using Amazon Web Services, Hadoop and our own code, we ingested 405,000 very large TIFF images, 3.3 million articles in SGML and 405,000 xml files mapping articles to rectangular regions in the TIFF’s. This data was converted to a more web-friendly 810,000 PNG images (thumbnails and full images) and 405,000 JavaScript files — all of it ready to be assembled into a TimesMachine. By leveraging the power of AWS and Hadoop, we were able to utilize hundreds of machines concurrently and process all the data in less than 36 hours.
-
-
03 Aug 08
-
28 May 08
-
TimesMachine is a collection of full-page image scans of the newspaper from 1851–1922 (i.e., the public domain archives). Organized chronologically and navigated by a simple calendar interface, TimesMachine provides a unique way to traverse the historical archives of The New York Times.
-
Using Amazon Web Services, Hadoop and our own code, we ingested 405,000 very large TIFF images, 3.3 million articles in SGML and 405,000 xml files mapping articles to rectangular regions in the TIFF’s. This data was converted to a more web-friendly 810,000 PNG images (thumbnails and full images) and 405,000 JavaScript files — all of it ready to be assembled into a TimesMachine. By leveraging the power of AWS and Hadoop, we were able to utilize hundreds of machines concurrently and process all the data in less than 36 hours.
-
-
26 May 08
-
24 May 08
-
23 May 08
-
22 May 08
-
TimesMachine is a collection of full-page image scans of the newspaper from 1851–1922 (i.e., the public domain archives). Organized chronologically and navigated by a simple calendar interface, TimesMachine provides a unique way to traverse the historical archives of The New York Times. Topics ranging from the Civil War to the sinking of the Titanic to the first cross-country auto race to women’s fashions in the 20s are just a few electronic flips away. And of course, there’s the advertisements.TimesMachine is a collection of full-page image scans of the newspaper from 1851–1922 (i.e., the public domain archives). Organized chronologically and navigated by a simple calendar interface, TimesMachine provides a unique way to traverse the historical archives of The New York Times. Topics ranging from the Civil War to the sinking of the Titanic to the first cross-country auto race to women’s fashions in the 20s are just a few electronic flips away. And of course, there’s the advertisements.
-
-
21 May 08
Would you like to comment?
Join Diigo for a free account, or sign in if you are already a member.