ApacheCon 2014 - What's New in Apache httpd 2.4
1 like1,168 views
The document summarizes new features in Apache HTTPD version 2.4, including improved performance through the Event MPM, faster APR, and reduced memory usage. It describes new configuration options like finer timeout controls and the <If> directive. New modules like mod_lua and mod_proxy submodules are highlighted. The document also discusses how Apache has adapted to cloud computing through dynamic proxying, load balancing, and self-aware environments.
![This work is licensed under a Creative Commons Attribution 3.0 Unported License.
Configuration - Runtime
➡ Finer control of timeouts, esp. during requests
➡ mod_reqtimeout
➡ KeepAliveTimout down to the millisecond
➡ Finer control over logging
➡ per module/per directory
➡ new logging levels (TRACE[1-8])
LogLevel info ssl:warn
<Directory "/usr/local/apache/htdocs/foo">
LogLevel debug
</Directory>](https://image.slidesharecdn.com/acna2014-httpd2-140408092621-phpapp01/85/ApacheCon-2014-What-s-New-in-Apache-httpd-2-4-11-320.jpg)
ApacheCon 2014 - What's New in Apache httpd 2.4
- 1. Jim Jagielski Apache httpd v2.4: What’s New, Pussycat? This should be pretty good!
- 2. This work is licensed under a Creative Commons Attribution 3.0 Unported License. About me ➡ Jim Jagielski ➡ Hacker and developer ➡ Wearer o’ many hats at the ASF ➡ Director and President: Outercurve ➡ Council member: MARSEC-XL ! ➡ Consulting Engineer with Red Hat ! ➡ @jimjag
- 3. This work is licensed under a Creative Commons Attribution 3.0 Unported License. httpd is sooo old school (aka fud) ➡ Apache doesn’t scale (its SLOW) ➡ http://www.youtube.com/watch?v=bzkRVzciAZg ➡ Apache is too generalized ➡ Apache is too complex (config file) ➡ really? ➡ Apache is too old (yeah, just like Linux) vs It’s Squagels!
- 4. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Apache httpd 2.4 - design drivers ➡ New features and improve old ones ➡ Support for async I/O w/o dropping support for older systems ➡ Larger selection of usable MPMs: added Event, Simple, etc... ➡ Leverage higher-performant versions of APR ➡ Increase performance ➡ Reduce memory utilization ➡ The Cloud Currently at version 2.4.9 (2.4.1 went GA Feb 21, 2012)
- 5. This work is licensed under a Creative Commons Attribution 3.0 Unported License. What’s New: Apache httpd 2.4 ➡ Performance Increases ➡ Configuration / Runtime Improvements ➡ New Modules / Capabilities ➡ Cloud / Proxy Enhancements
- 6. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Performance ➡ Event MPM : no longer experimental ➡ Faster, more efficient APR ➡ Smaller memory footprint ➡ More efficient data structures (worker and event)
- 7. This work is licensed under a Creative Commons Attribution 3.0 Unported License. nginx vs Event (typical) Apache - Event MPM 0 500 1000 1500 2000 nginx 0 500 1,000 1,500 2,000 Open Write Read Close Increasing concurrency Increasing concurrency
- 8. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Total req/resp time Comparison - total transaction (close) 0 500 1000 1500 2000 Prefork Worker Event nginx Increasing concurrency
- 9. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Resp to Req. Bursts - httperf100 ---> 10000 0.00 1.75 3.50 5.25 7.00 min avg max dev min avg max dev min avg max dev min avg max dev min avg max dev min avg max dev prefork worker event nginx Increasing concurrency
- 10. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Independent benchmark Source: Ryosuke Matsumoto : http://blog.matsumoto-r.jp/?p=1812 #!/bin/sh! RESULT='./result.txt'! ! for port in 80 8080 8888! do! #for count in 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000! #for count in 11000 12000 13000 14000 15000 16000 17000 18000 19000 20000! for count in 21000 22000 23000 24000 25000 26000 27000 28000 29000 30000! do! echo -n "$port $count " >> $RESULT! httperf --rate $count --num-conns 25000 --server ipaddr --port $port ! --uri=/test.html | grep "Request rate:" >> $RESULT.$port! sleep 60! done! done!
- 11. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Configuration - Runtime ➡ Finer control of timeouts, esp. during requests ➡ mod_reqtimeout ➡ KeepAliveTimout down to the millisecond ➡ Finer control over logging ➡ per module/per directory ➡ new logging levels (TRACE[1-8]) LogLevel info ssl:warn <Directory "/usr/local/apache/htdocs/foo"> LogLevel debug </Directory>
- 12. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Configuration - Runtime ➡ <If> supports per-request conditions # Compare the host name to example.com and # redirect to www.example.com if it matches <If "%{HTTP_HOST} == 'example.com'"> Redirect permanent / http://www.example.com/ <ElseIf "%{HTTP_HOST} == ‘foobarfoo.com'"> Redirect permanent / http://www2.example.com/ </If>
- 13. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Configuration - Runtime ➡ Require ➡ Removes order/deny insanity! AuthType Basic AuthName "Restricted Resource" AuthBasicProvider file AuthUserFile /web/users AuthGroupFile /web/groups Require group admin <Directory /www/docs> <RequireAll> Require group alpha beta Require not group reject </RequireAll> </Directory> <Directory /www/docs2> Require all granted </Directory>
- 14. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Configuration - Runtime ➡ Simple config-file variables: <Define> <IfDefine TEST> Define servername test.example.com </IfDefine> <IfDefine !TEST> Define servername www.example.com Define SSL </IfDefine> ! DocumentRoot /var/www/${servername}/htdocs
- 15. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Configuration - Runtime ➡ Other stuff: ➡ General purpose expression parser (BNF compatible) ➡ No more NameVirtualHost ➡ Loadable MPM modules
- 16. This work is licensed under a Creative Commons Attribution 3.0 Unported License. New Modules ➡ mod_macro <Macro VHost $name $domain> <VirtualHost *:80> ServerName $domain ServerAlias www.$domain ! DocumentRoot /var/www/vhosts/$name ErrorLog /var/log/httpd/$name.error_log CustomLog /var/log/httpd/$name.access_log combined </VirtualHost> </Macro> ! Use VHost example example.com Use VHost myhost hostname.org Use VHost apache apache.org ! UndefMacro VHost From my ApacheCon 2000 Preso
- 17. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Need More Info? ➡ Attend the next session! ➡ Rich Bowen @ 11:55am ➡ Configurable Configuration in httpd 2.4
- 18. This work is licensed under a Creative Commons Attribution 3.0 Unported License. New Modules ➡ mod_lua (semi-experimental, but we use it!) <Files *.lua> SetHandler lua-script </Files> … example.lua require "string" function handle(r) r.content_type = "text/plain" ! if r.method == 'GET' then r:puts("Hello Lua World!n") for k, v in pairs( r:parseargs() ) do r:puts( string.format("%s: %sn", k, v) ) end elseif r.method == 'POST' then r:puts("Hello Lua World!n") for k, v in pairs( r:parsebody() ) do r:puts( string.format("%s: %sn", k, v) ) end elseif r.method == 'PUT' then r:puts("Unsupported HTTP method " .. r.method) r.status = 405 return apache2.ok else return 501 end return apache2.OK end
- 19. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Need More Info? ➡ Attend the latter session! ➡ Daniel Gruno @ 5:00pm ➡ (Re)Introducing mod_lua
- 20. This work is licensed under a Creative Commons Attribution 3.0 Unported License. New Modules ➡ mod_proxy submodules: ➡ mod_proxy_fcgi ➡ mod_proxy_scgi ➡ mod_proxy_wtunnel ➡ mod_proxy_html ➡ mod_proxy_express ProxyExpressEnable on ProxyExpressDBMFile emap … ## ##express-map.txt: httxt2dbm -i express-map.txt -o emap ## www1.example.com http://192.168.002.2:8080 www2.example.com http://192.168.002.12:8088 www3.example.com http://192.168.002.10 ... www6341.example.com http://192.168.211.26
- 21. This work is licensed under a Creative Commons Attribution 3.0 Unported License. New Modules ➡ mod_buffer ➡ buffer the i/o stacks w/i httpd ➡ mod_sed ➡ True sed functionality, alternate to mod_substitute ➡ mod_remoteip ➡ allow access to the real client IP address ➡ mod_session ➡ easily maintain application server state ➡ …
- 22. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Cloud and Performance ➡ The Cloud is a game changer for web servers ➡ Horizontal scalability is no longer as painful ➡ Concurrency is no longer the sole consideration ➡ ... or maybe even the primary one ➡ What’s important now? Transaction Time! (because it CAN be) ➡ Low latency ➡ Fast req/resp turnover ➡ Does density still matter? Of course! ➡ Are there environs where super-mega concurrency is the bugaboo? You betcha! (but the cloud makes these more and more rare, and you’re likely using a bad architecture anyway)
- 23. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Cloud and Dynamics ➡ The Cloud is a game changer for web servers ➡ The cloud is a dynamic place ➡ automated reconfiguration ➡ horizontal, not vertical scaling ➡ self-aware environments OK, maybe not THAT self-aware
- 24. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Why Dynamic Proxy Matters ➡ Apache httpd still the most frequently used front-end ➡ Proxy capabilities must be cloud friendly ➡ Front-end must be dynamic friendly
- 25. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Apache httpd 2.4 proxy ➡ Reverse Proxy Improvements ➡ Supports FastCGI, SCGI, Websockets in balancer ➡ Additional load balancing mechanisms ➡ Runtime changing of clusters w/o restarts ➡ Support for dynamic configuration ➡ mod_proxy_express ➡ mod_fcgid and fcgistarter ➡ Brand New: Support for Unix Domain Sockets
- 26. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Putting it all together <Proxy balancer://foo> BalancerMember http://php1:8080/ loadfactor=1 BalancerMember http://php2:8080/ loadfactor=4 BalancerMember http://phpbkup:8080/ loadfactor=1 status=+h BalancerMember http://phpexp:8080/ lbset=1 ProxySet lbmethod=bytraffic </Proxy> <Proxy balancer://javaapps> BalancerMember ajp://tc1:8089/ loadfactor=1 BalancerMember ajp://tc2:8089/ loadfactor=4 ProxySet lbmethod=byrequests </Proxy> ProxyPass /apps/ balancer://foo/ ProxyPassReverse /apps/ balancer://foo/ ProxyPass /serv/ balancer://javaapps/ ProxyPass /images/ http://images:8080/ ProxyPass /foo unix:/home/www.socket|http://localhost/bar/
- 27. This work is licensed under a Creative Commons Attribution 3.0 Unported License. HeartBeat / HeartMonitor ➡ New LB (load balance) method ➡ Uses multicast between gateway and reverse proxies ➡ Provides heartbeat (are you there?) capability ➡ Also provides basic load info ➡ This info stored in shm, and used for balancing ➡ Multicast can be an issue ➡ Use mod_header with %l, %i, %b (loadavg, idle, busy) ➡ but no LBmethod currently uses this :( ➡ We need a universal “load” measure
- 28. This work is licensed under a Creative Commons Attribution 3.0 Unported License. balancer-manager ➡ Embedded proxy admin web interface ➡ Allows for real-time ➡ Monitoring of stats for each worker ➡ Adjustment of worker params ➡ Allows for real-time ➡ Addition of new workers/nodes ➡ Change of LB methods ➡ Can be persistent! ➡ More RESTful ➡ Can be CLI-driven
- 29. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Need More Info? ➡ Attend the upcoming sessions! ➡ Daniel Ruggeri today @ 3:00pm ➡ mod_proxy Cookbook ➡ Jeff Trawick tomorrow @ 10:30am ➡ Using FastCGI with Apache httpd 2.4
- 30. This work is licensed under a Creative Commons Attribution 3.0 Unported License. Thanks Twitter: @jimjag Emails: jim@jaguNET.com jjagielski@outercurve.org jim@apache.org jimjag@redhat.com http://www.slideshare.net/jimjag/