Memcached B box presentation
Download as PPTX, PDF0 likes888 views
Memcached is an in-memory key-value store used for caching database query results and API responses to improve performance. It was created by Danga Interactive to speed up LiveJournal and reduces database load. Many large sites use it like Wikipedia, Twitter, YouTube. Memcached resides on servers separately from databases for fast read/write of small chunks of data. It improves response times by caching content before databases and reduces database load. Languages like PHP, Python, Java have Memcached APIs.
Memcached B box presentation
- 2. What is memcached briefly? Memcached is a high-performance, distributed memory object caching system, generic in nature Memcache is an in-memory key-value store for small chunks of arbitrary data (strings, objects) from results of database calls, API calls, or page rendering. Memcache is not faster than database, but it's faster than database when connections and requests increase.
- 3. Why was memcached made? • It was originally developed by Danga Interactive to enhance the speed of LiveJournal.com • It dropped the database load to almost nothing, yielding faster page load times for users, better resource utilization, and faster access to the databases on a memcache miss • http://www.danga.com/memcached/
- 4. Memcached Users • • • • • • • • • • LiveJournal Wikipedia Flickr Twitter Youtube Dig Wordpress Craigslist Facebook (around 200 dedicated memcache servers) Yahoo! India Movies
- 5. Where does memcached reside? • Memcache is not part of the database but sits outside it on the server(s). • Memcache is not meant for providing any backup support. Its all about simple read and write.
- 6. Why use memcached? • To reduce the load on the database by caching data BEFORE it hits the database • Can be used for more then just holding database results (objects) and improve the entire application response time • Feel the need for speed • Memcache is in RAM - much faster then hitting the disk or the database
- 7. Why not use memcached? • Memcache is held in RAM. This is a finite resource. • Adding complexity to a system just for complexities sake is a waste. If the system can respond within the requirements without it leave it alone
- 8. What are the limits of memcached? • Keys can be no more then 250 characters • Stored data can not exceed 1M (largest typical slab size) • There are generally no limits to the number of nodes running memcache • There are generally no limits the the amount of RAM used by memcache over all nodes • 32 bit machines do have a limit of 4GB though
- 9. First User Request • First request goes to database server at the same time data object storing in Memcached server.
- 10. Second User Request • Second user request data comes from Memcached object.
- 11. How do I easily install memcached? • You can build and install memcached from the source code directly, or you can use an existing operating system package or installation. • on a RedHat, Fedora or CentOS host, use yum: • root-shell> yum install memcached • on a Debian or Ubuntu host, use apt-get: • root-shell> apt-get install memcached • on a Gentoo host, use emerge: • root-shell> emerge install memcached • on OpenSolaris, use the pkg for SUNWmemcached: • root-shell> pkg install SUNWmemcached
- 12. How do I compile memcached from source? • Get the source from the website: http://www.danga.com/memcached/downloa d.bml • Memcache has a dependancy on libevent so make sure you have that also. • Decompress, cd into the dir • ./configure;make;make install;
- 13. How do I start memcached? • Memcached can be run as a non-root user if it will not be on a restricted port (<1024) though the user can not have a memory limit restriction • shell> memcached • Default configuration - Memory: 64MB, all network interfaces, port:11211, max simultaneous connections: 1024
- 14. How can I connect to memcached? • Memcached uses a protocol that many languages implement with an API. • Languages that implement it: • Perl, PHP, Python, Ruby, Java, C#, C, Lua, Postgres, MySQL, Chicken Scheme • And yes - because it is a protocol you can even use telnet • shell> telnet localhost 11211
- 15. Memcached protocol • 3 types of commands • Storage - ask the server to store some data identified by a key • set, add, replace, append, prepend and cas • Retrieval - ask the server to retrieve data corresponding to a set of keys • get, gets
- 16. PHP Script • Information about the PHP API at http://www.php.net/memcache <?php // make a memcache object $memcache = new Memcache; // connect to memcache $memcache->connect('localhost', 11211) or die ("Could not connect"); //get the memcache version $version = $memcache->getVersion(); echo "Server's version: ".$version."<br/>n";
- 17. PHP Script (con’t) // test data $tmp_object = new stdClass; $tmp_object->str_attr = 'test'; $tmp_object->int_attr = 123; // set the test data in memcache $memcache->set('key', $tmp_object, false, 10) or die ("Failed to save data at the server"); echo "Store data in the cache (data will expire in 10 seconds)<br/>n"; // get the data $get_result = $memcache->get('key'); echo "Data from the cache:<br/>n"; echo ‘<pre>’, var_dump($get_result), ‘</pre>’;
- 18. PHP Script (con’t) // modify the data $tmp_object->str_attr = ‘boo’; $memcache->replace(‘key’, $tmp_object, false, 10) or die(“Failed to save new data to the server<br/>n”); Echo “Stored data in the cache changed<br/>n”; // get the new data $get_result = $memcache->get(‘key’); Echo “New data from the cache:<br/>n”; Echo ‘<pre>’, var_dump($get_result), “</pre>n”; // delete the data $memcache->delete(‘key’) or die(“Data not deleted<br/>n”);
- 19. Possible ways to secure memcached • It has no authentication system - so protection is important • Run as a non-priveledged user to minimize potential damage • Specify the ip address to listen on using -l • 127.0.0.1, 192.168.0.1, specific ip address • Use a non-standard port • Use a firewall