This link has been bookmarked by 66 people . It was first bookmarked on 03 Aug 2006, by Sean E Keener.
-
30 Dec 08
-
04 Sep 08
-
29 Mar 08
Bruno MartinsContinuing my series of queries about how "Web 2.0" companies used databases, I asked Cal Henderson of Flickr to tell me "how the folksonomy model intersects with the traditional database. How do you manage a tag cloud?"
architecture clustering database development flickr optimization programming research web web2.0
-
22 Jan 08
-
21 Jan 08
-
-
"started as a big vertically scaled classic replication tree (well, started as a single box) and soon hit against performance walls in terms of writes (repl gives you more reads, same writes as slowest machine in your tree). when we started, we barely knew anything about how mysql works with indexes (the documentation is fairly non-beginner), so months of index wrangling to get better performance ensued.
-
-
02 Nov 07
Jason WehmhoenerHe replied: "lots of the 'web 2.0' feature set doesn't fit well with traditional normalised db schema design. denormalization (or heavy caching) is the only way to generate a tag cloud in milliseconds for hundereds of millions of tags. you can cache stuff
database flickr web2.0 architecture mysql optimization data scalability sql delicious
-
18 Oct 07
-
13 Sep 07
-
09 Sep 07
Hendy IrawanI also asked for any information on the scale of data Flickr manages and its growth rates. Cal answered:
total stored unique data : 935 GB
total stored duplicated data : ~3TB2 ajax backup article blogging blog blogs business design programming optimization mysql architecture flickr web2.0 database
-
28 Aug 07
-
09 Aug 07
-
05 Aug 07
-
28 Jun 07
-
11 Jun 07
-
26 Apr 07
-
25 Mar 07
-
24 Mar 07
-
Database War Stories
-
-
29 Jan 07
-
24 Jan 07
-
haraldgrovenHow to make a web2.0 data service manageble, even if the amount of meta data (text, comments, tags and user info) is 3TB
database scalability sql db flickr dbarchitechture for:yngvewb mysql fromDelicious
-
27 Aug 06
-
07 Aug 06
-
03 Aug 06
-
30 Jul 06
Ivo FrazãoArtigo falando de como o Flickr usa banco de dados
-
24 Jun 06
-
21 May 06
-
20 May 06
Rachel CTim O'Reilly's interview with Cal Henderson of Flickr, on 27 April 2006
O'Reilly TimOReilly flickr database statistics interview CalHenderson web2.0 information architecture programming
-
09 May 06
-
02 May 06
-
29 Apr 06
-
28 Apr 06
-
ken .Denormalising db to cope with millions of tags and achieve acceptable response time (without offline processing), backups (with 935gb unique tag data, no graphics), federated spaces etc.
database design development folksonomy mysql programming tagging web
Would you like to comment?
Join Diigo for a free account, or sign in if you are already a member.