DJHell .'s Library tagged scaling →  View Popular

Slony-I is a "master to multiple slaves" replication system supporting cascading (e.g. - a node can feed another node which feeds another node...) and failover.

The big picture for the development of Slony-I is that it is a master-slave replication system that includes all features and capabilities needed to replicate large databases to a reasonably limited number of slave systems.

Slony-I is a system designed for use at data centers and backup sites, where the normal mode of operation is that all nodes are available

www.slony.info - Preview

Open Source database scaling PostgreSQL Slony replication

Slony is the Russian plural for elephant. It is also the name of the new replication project being developed by Jan Weick. The mascot for Slony, Slon, is a good variation of the usual Postgres elephant mascot, created by Jan.

onlamp.com/...slony.html - Preview

Open Source database PostgreSQL Slony articles replication scaling

The lbpool project provides a load balancing JDBC driver for use with DB connection pools. It wraps a normal JDBC driver providing reconnect semantics in the event of additional hardware availability, partial system failure, or uneven load distribution. It also evenly distributes all new connections among slave DB servers in a given pool. Each time connect() is called it will attempt to use the best server with the least system load.

code.tailrank.com/lbpool - Preview

Open Source scaling database lbpool Java JDBC

HiveDB is an open source framework for horizontally partitioning MySQL systems. Building scalable and high performance MySQL-backed systems requires a good deal of expertise in designing the system and implementing the code. One of the main strategies for scaling MySQL is by partitioning your data across many servers. While it is not difficult to accomplish this, it is difficult to do it in such a way that the system is easily maintained and transparent to the developer.

www.hivedb.org - Preview

Open Source database MySQL HiveDB scaling

HAProxy is a free, very fast and reliable solution offering high availability, load balancing, and proxying for TCP and HTTP-based applications. It is particularly suited for web sites crawling under very high loads while needing persistence or Layer7 processing. Supporting tens of thousands of connections is clearly realistic with todays hardware. Its mode of operation makes its integration into existing architectures very easy and riskless, while still offering the possibility not to expose fragile web servers to the Net

haproxy.1wt.eu/ - Preview

Open Source HAProxy Load Balancing scaling Linux

This is dynomite. It is a clone of the amazon dynamo key value store written in Erlang.

github.com/...master - Preview

Open Source database Dynamo dynomite scaling distributed

project-voldemort.com/design.php - Preview

Open Source database scaling Voldemort

HBase is the Hadoop database. Its an open-source, distributed, column-oriented store modeled after the Google paper, Bigtable: A Distributed Storage System for Structured Data by Chang et al. Just as Bigtable leverages the distributed data storage provided by the Google File System, HBase provides Bigtable-like capabilities on top of Hadoop.

HBase's goal is the hosting of very large tables -- billions of rows X millions of columns -- atop clusters of commodity hardware. Try it if your plans for a data store run to big.

hadoop.apache.org/hbase - Preview

Hadoop database HBase Open Source Bigtable scaling

As millions of users flood the Internet, websites must be able to handle vast numbers of users. Theo Schlossnagle's Scalable Internet Architecture teaches developers both good and bad design methodologies for building new sites, and how to scale existing websites to robust, high-availability websites. Primarily example-based, the book discusses major topics in Web architectural design, presenting existing solutions and how they fit. Schlossnagle introduces new and innovative concepts to solving traditionally expensive problems without a large technology budget. Using open source and proprietary examples, the book discusses best practice design methodologies for building new sites, as well as appropriately scaling both growing and shrinking sites. Scalable Internet Architecture illustrates the progression from anecdotal conclusions to real-world, practical results and often how the two are askew. Topics include: clustering, databases, high-availability, load-balancing, and caching architectures

scalableinternetarchitectures.com/...about - Preview

Books scaling architecture Web

This comprehensive guide covers the design of software and hardware systems for web applications. Using scores of examples and leading-edge tips, it details proven methods for scaling web applications to millions of users. Topics include application architecture, development practices, technologies, Unicode, and general infrastructure work. Ideal for anyone ready to realize the cost and performance benefits available to web applications today.

oreilly.com/9780596102357 - Preview

O'Reilly Books scaling web cluster

Web-based companies live or die by the ability to scale their infrastructure to accommodate increasing demand. This book is a hands-on and practical guide to planning for such growth, with many techniques and considerations to help you plan, deploy, and manage web application infrastructure. Written by the manager of data operations for the world-famous photo-sharing site Flickr.com, the author offers advice based on years of valuable experience.

oreilly.com/9780596518578 - Preview

scaling cluster monitoring books it server administration O'Reilly