Skip to main content

Joel Liu's Library tagged scalability →  View Popular, Search in Google

Jul
17
2009

    • 16 million page views a month
       
    • 3 million unique visitors a month (Facebook reaches 77 million unique visitors a month)
       
    • 6 million visits a month
       
    • 86% of traffic comes from Google
       
    • 9 million active programmers in the world and 30% have used Stack Overflow. 
    • If you’re comfortable managing servers then buy them. The two biggest problems with renting costs were: 1) the insane cost of memory and disk upgrades 2) the fact that they [hosting providers] really couldn’t manage anything.
       
    • Make larger one time up front investments to avoid recurring monthly costs which are more expensive in the long term.
  • 3 more annotation(s)...
Sep
14
2007

  • Update 6: Some interesting changes from Twitter's Evan Weaver: everything in RAM now, database is a backup; peaks at 300 tweets/second; every tweet followed by average 126 people; vector cache of tweet IDs; row cache; fragment cache; page cache; keep separate caches; GC makes Ruby optimization resistant so went with Scala; Thrift and HTTP are used internally; 100s internal requests for every external request; rewrote MQ but kept interface the same; 3 queues are used to load balance requests; extensive A/B testing for backwards capability; switched to C memcached client for speed; optimize critical path; faster to get the cached results from the network memory than recompute them locally.
Jul
3
2008

  • Measure the right thing.
     - People ask about how many IMs do you deliver or how many active users. Turns out not to be the right engineering question.
     - Hard part of IM is how to show correct present to all connected users because growth is non-linear: ConnectedUsers * BuddyListSize * OnlineStateChanges
     - A linear user grown can mean a very non-linear server growth which requires serving many billions of presence packets per day.
     - Have a large number friends and presence explodes. The number IMs not that
     big of deal.
Dec
13
2008

  • If you've read anything about scaling large websites, you've probably heard about memcached. memcached is a high-performance, distributed memory object caching system. Here at Facebook, we're likely the world's largest user of memcached. We use memcached to alleviate database load. memcached is already fast, but we need it to be faster and more efficient than most installations. We use more than 800 servers supplying over 28 terabytes of memory to our users. Over the past year as Facebook's popularity has skyrocketed, we've run into a number of scaling issues. This ever increasing demand has required us to make modifications to both our operating system and memcached to achieve the performance that provides the best possible experience for our users.
1 - 20 of 37 Next ›
Showing 20▼ items per page

Selected Tags

Related Tags

Diigo is about better ways to research, share and collaborate on information. Learn more »

Join Diigo
Move to top