Skip to main content

Get the best research tool on the web today,and free!
Connect with people with common interests!

Play Webslides

Wade Ren's Bookmarks tagged scalability → View Popular

You are here: Diigo Home > Wade Ren's Bookmarks

Expand All 1 - 20 of 28 Next ›

New Facebook Chat Feature Scales to 70 Million Users Using Erlang | High Scalability

Tags: erlang, scalability on 2008-05-25 and saved by2 people -All Annotations (0) -About

more fromhighscalability.com

1Expand

IT Conversations: Paul Tuckfield

Tags: mysql, scalability on 2008-01-01 and saved by4 people -All Annotations (0) -About

more fromitc.conversationsnetwork.org

1Expand

Inside the Linux scheduler

Tags: linux, scalability, scheduler on 2007-11-18 and saved by4 people -All Annotations (0) -About

more fromwww-128.ibm.com

7Expand

Scaling Twitter: Making Twitter 10000 Percent Faster | High Scalability

Tags: performance, scalability on 2007-09-16 and saved by21 people -All Annotations (0) -About

more fromhighscalability.com

For example, they store all a user IDs friend IDs together, which prevented a lot of costly joins.
Build in user limits. People will try to bust your system. Put in reasonable limits and detection mechanisms to protect your system from being killed.
Abuse

- A lot of down time because people crawl the site and add everyone as friends. 9000 friends in 24 hours. It would take down the site.
- Use caching with memcached a lot.
  
  - For example, if getting a count is slow, you can memoize the count into memcache in a millisecond.
  
  - Getting your friends status is complicated. There are security and other issues. So rather than doing a query, a friend's status is updated in cache instead. It never touches the database. This gives a predictable response time frame (upper bound 20 msecs).
  
  - ActiveRecord objects are huge so that's why they aren't cached. So they want to store critical attributes in a hash and lazy load the other attributes on access.
- Be ruthless. Delete them as users.
Moved to Starling, a distributed queue written in Ruby.

- Distributed queues were made to survive system crashes by writing them to disk. Other big websites take this simple approach as well.
- Send message to invalidate friend's cache in the background instead of doing all individually, synchronously.

Nirvanix To Challenge Amazon S3

Tags: s3, scalability on 2007-08-15 -All Annotations (0) -About

more fromwww.techcrunch.com

1Expand

facebook’s thrift: scalable cross-language development

Tags: facebook, scalability on 2007-06-25 -All Annotations (0) -About

more fromwww.sdforum.org

Portable Playlist: Surviving the Digg Effect.

Tags: scalability on 2006-05-03 -All Annotations (0) -About

more fromwww.portableplaylist.com

The adventures of scaling, Stage 4

Tags: deployment, scalability on 2006-04-04 and saved by4 people -All Annotations (0) -About

more frompoocs.net

4Expand

The adventures of scaling, Stage 2

Tags: deployment, scalability on 2006-04-04 and saved by6 people -All Annotations (0) -About

more frompoocs.net

Thing is, while multiple MySQL threads can update multiple tables (or even multiple rows in a single table through InnoDB’s row level locking) at once, you only get a single process handling the writes of the other master. Something that’s a clear win by numbers for the local database threads over the remote replication process. And that got us in trouble. More than once.
Driven by reports of better performance in general and improved memory and process management in the Linux Kernel series 2.6 we upgraded all machines from 2.4.27 to 2.6.14 somewhere around mid December. Believe it or not, according to the Cacti graphs it did indeed make a difference. Not as much for the database servers, but the load on the application servers dropped significantly. Records show the system load went down from 8 to 5 in busy hours. Just by upgrading the kernel that is.
Tuning connection related settings in MySQL should not be necessary as your dispatchers use a single, persistent connection to your database.
Basically you have to cover your tracks in the peak hours while not clogging a single machine with so many processes in parallel that it crawls to a halt because of processes blocking each other at the CPU level. This is what your system load tells you.

The adventures of scaling, Stage 1

Tags: ruby, scalability on 2006-04-04 and saved by13 people -All Annotations (0) -About

more frompoocs.net

PHP benchmarks | Gentoo : Intel® Pentium® 4 Computer Language Shootout Benchmarks

Tags: scalability on 2006-03-27 -All Annotations (0) -About

more fromshootout.alioth.debian.org

Modeling the Real World for Load Testing Web Sites

Tags: scalability on 2006-03-21 and saved by2 people -All Annotations (0) -About

more fromwww.methodsandtools.com

从LiveJournal后台发展看大规模网站性能优化方法: 一个藏袍

Tags: livejournal, scalability on 2006-03-17 and saved by14 people -All Annotations (0) -About

more fromwww.example.net.cn

MySQL Forums :: Cluster :: Proposed Cluster Server Architecture and Replication Questions

Tags: cluster, mysql, scalability on 2006-03-02 -All Annotations (0) -About

more fromforums.mysql.com

Friendster scales the network with open source | InfoWorld | Analysis | 2005-04-04 | By Cathleen Moore

Tags: friendster, scalability, site-operations on 2006-03-02 -All Annotations (0) -About

more fromweblog.infoworld.com

web app performance

Tags: performance, scalability on 2006-03-02 -All Annotations (0) -About

more fromwww.bsc.es

livejournal experience

Tags: mysql, scalability on 2006-03-02 -All Annotations (0) -About

more fromwww.mysqluc.com

1Expand

» Blog Archive » mod meebo

Tags: meebo, scalability on 2006-03-02 -All Annotations (0) -About

more fromblog.meebo.com

1Expand

» Blog Archive » developing meebo

Tags: meebo, scalability, software-development on 2006-03-02 -All Annotations (0) -About

more fromblog.meebo.com

developing meebo

Tags: meebo, scalability, software-development on 2006-03-02 and saved by2 people -All Annotations (0) -About

more fromblog.meebo.com

1 - 20 of 28 Next ›

List 20 50 100

Notation: * = Private bookmark and comment|… = Clipping [?] | … = Public highlight [?]

Wade Ren's Related Tags

Selected tags

scalability

Related tags

See More Top Contributors

sriks6711 aj takayuki kawamoto morrita Benjamin Reitzammer Tim Goh

Related Groups on Diigo

flyland

Members (2)

bookmarks (125)
Symfony

Members (8)

bookmarks (166)
Drupal in education

Members (19)

bookmarks (23)