Skip to main content

marcell mars's Library tagged conversion   View Popular

05 Sep 09

Converting 11 million articles from TIFF to PDF-s on amazon EC2 & S3: Self-service, Prorated Super Computing Fun!

"I was ready to deploy Hadoop and my code on a cluster of EC2 machines. For deployment, I created a custom AMI (Amazon Machine Image) for EC2 that was based on a Xen image from my desktop machine. Using some simple Python scripts and the boto library, I booted four EC2 instances of my custom AMI. [..] thanks to the swell people at Amazon, I got access to a few more machines and churned through all 11 million articles in just under 24 hours using 100 EC2 instances, and generated another 1.5TB of data to store in S3."

open.blogs.nytimes.com/...e-prorated-super-computing-fun - Preview

amazon distribution compute conversion programming linux java python storage

  • I was ready to deploy Hadoop and my code on a cluster of EC2 machines. For deployment, I created a custom AMI (Amazon Machine Image) for EC2 that was based on a Xen image from my desktop machine. Using some simple Python scripts and the boto library, I booted four EC2 instances of my custom AMI. I logged in, started Hadoop and submitted a test job to generate a couple thousands articles — and to my surprise it just worked.


    I then began some rough calculations and determined that if I used only four machines, it could take some time to generate all 11 million article PDFs. But thanks to the swell people at Amazon, I got access to a few more machines and churned through all 11 million articles in just under 24 hours using 100 EC2 instances, and generated another 1.5TB of data to store in S3.

21 Jun 08

Latitude and Longitude of a Point

Get the Latitude and Longitude of a Point. When you click on the map, move the marker or enter an address the latitude and longitude coordinates of the point are inserted in the boxes below.

itouchmap.com/latlong.html - Preview

map diy google hardware gps measure compare conversion

  • Get the Latitude and Longitude of a Point


    When you click on the map, move the marker or enter an address the latitude and longitude coordinates of the point are inserted in the boxes below.

09 Jan 08

O c c a m

  • proposal on howo to convert midi to osc and vice versa...
    - marcell on 2007-07-21
  • /osc/midi/out/noteOn
    channel (int)
    key (int)
    velocity (int)

    /osc/midi/out/noteOff
    channel (int)
    key (int)
    velocity (int)

    /osc/midi/out/polyTouch
    channel (int)
    key (int)
    pressure (int)

    /osc/midi/out/control
    channel (int)
    index (int)
    value (int)

    /osc/midi/out/program
    channel (int)
    index (int)

    /osc/midi/out/touch
    channel (int)
    pressure (int)

    /osc/midi/out/bend
    channel (int)
    value (int)

    /osc/midi/out/allNotesOff
    channel (int)
1 - 10 of 10
Showing 20 items per page

Diigo is about better ways to research, share and collaborate on information. Learn more »

Join Diigo