Gearman, Supervisor and PHP - Job Management with Sanity!
Download as PPTX, PDF5 likes9,162 views
This document discusses using Gearman, PHP, and Supervisor together for job management. Gearman is a job queue and processing system that allows distributing work across multiple machines. It was used to build a deployment solution that processes tasks instantly across daemons. While PHP is not suited for long-running processes, Gearman and Supervisor address this by running PHP workers as daemons and restarting any terminated processes. This combination of tools provided an instant and scalable solution for deployment tasks like fetching code repositories and uploading files to servers.
Gearman, Supervisor and PHP - Job Management with Sanity!
- 1. Supervisor, Gearman and PHP - Job management with sanity! ABU ASHRAF MASNUN
- 2. What is it all about? PHP Gearman Supervisor Job Management
- 3. Let’s get REAL! Deploy Ninja – A case study PROPOSED FEATURES Deployment Solution (SVN to s/FTP) Trigger URL – Web Hooks Deploy Now – Deploy the latest right now Full Deploy – Upload the entire repo again
- 4. How to train our Ninja? What did we have to do? REQUIREMENTS Tasks Involved: Fetch the repo Upload to the server Instant processing Process separation for the three deployment types
- 5. And cometh the tragedy! The day my life sucked !^@# ARCHITECTURAL CHALLENGES Instant processing requires “Daemons” PHP was not built for long running processes! Premature termination & Zombie processes. Monitoring the processes. Restarting the processes when terminated.
- 6. Gearman, the super hero! He came and saved my a$$ GEARMAN FEATURES Distributed workload management Client – Worker Architecture Multiple workers Multi-lingual workers
- 7. Gearman: How it works? Understanding Gearman
- 8. Gearman: Installation Are you ready? QR Code Install Gearman: sudo apt-get install gearman Install Libgearman: sudo apt-get install libgearman-dev Install the PHP Extension: sudo pecl install channel://pecl.php.net/gearman-0.8.0
- 9. Gearman: Daemonizing! Starting Gearman QR Code Running Gearman Daemon: sudo gearman –d –u root Debugging Gearman (Verbose mode) : sudo gearman –d -vvv –u root
- 10. QR Code Gearman: Workers PHP Worker
- 11. QR Code Gearman: Workers Breaking it down!
- 12. QR Code Gearman: Workers Breaking it down!
- 13. QR Code Gearman: Clients Requesting a job!
- 14. Gearman: Alternatives! Who else is there? RabbitMQ ZeroMQ Apache MQ Dropr Microsoft MQ
- 15. Whew! Almost done! Life is getting better CHALLENGES STATUS Instant processing requires “Daemons” PHP was not built for long running processes! Premature termination & Zombie processes. Monitoring the processes. Restarting the processes when terminated.
- 16. Meet Supervisor! Here comes the tough guy! SUPERVISOR FEATURES Simple & Centralized Efficient & Extensible Compatible & Proven It monitors your processes and restarts as instructed!
- 17. Supervisor: Installation! Let’s go! QR Code sudo apt-get install python-setuptools sudo easy_install supervisor
- 18. Supervisor: Getting Started! Config, debug and run! QR Code sudo echo_supervisord_conf > /etc/supervisord.conf sudo supervisord -n sudo supervisord
- 19. Hurray! We’re done! Life is so good :D CHALLENGES STATUS Instant processing requires “Daemons” PHP was not built for long running processes! Premature termination & Zombie processes. Monitoring the processes. Restarting the processes when terminated.
- 20. What’s your Story? You can do it too! USE CASES Image Processing? Cache Regeneration? Mass emails?
- 21. That was Simple! Eh? Got anything to ask?
- 22. The Leevian! Who am I? ABU ASHRAF MASNUN Software Engineer @ Leevio http://masnun.com masnun@leevio.com