Passenger 6 generic language support presentation

1. PASSENGER  GENERIC LANGUAGE SUPPORT 2018 live stream

2. TABLE OF CONTENTS 1. Why? 2. UX goal 3. Passenger architecture 4. Implementation plan 5. Coding!

3. Questions?  Comments? Enter them in the chat  (or post on Github)

4. ➤ Bring all the good stuﬀ of Passenger to the whole world ➤ Standardization ➤ Onboard team members faster ➤ Streamline procedures ➤ Reduce inconsistencies ➤ Share and retain operational knowledge ➤ Focus ➤ Write less code ➤ Reduce infrastructure complexity ➤ Automate the boring details ➤ Focus on your core business Why GLS?

5. UX?

6. Ask for a  command string! Like Heroku's Procfile

7. USER EXPERIENCE (1/2) server { listen 80; server_name foo.com; root /webapps/fooapp/public; passenger_enabled on; passenger_app_start_command './fooexe --port=$PORT'; }

8. USER EXPERIENCE (2/2) # Passengerfile.json { "app_start_command": "./fooexe --port=$PORT" } # Nginx config server { listen 80; server_name foo.com; root /webapps/fooapp/public; passenger_enabled on; # Look, no passenger_app_start_command! }

9. Passenger architecture 101

16. We need to  modify these!

17. Passenger agent Config Core ApiServer Controller main request handling server Security Update Checker Telemetry Collector Contains most Passenger business logic. Manages processes, routes requests. Config ApiServerCoreWatcher InstanceDir Toucher Watchdog Starts and supervises the Core. ApplicationPool Pool main subsystem interface Options collection of app config; collection of parameters for a get() call Session represents a single request/response session with a specific process Group represents an app; a collection of processes Process represents a single app process Socket represents a server socket endpoint that a process listens on Context global subsystem configuration Public interface Internals Abstracts application process spawning and management logic into a simple API. Keeps track of processes and related statistics. SpawnEnvSetupper Exec wrapper used by SpawningKit. Sets up the process environment, then executes the actual application command. ExecHelper executes a command as a specific user, similar to sudo Utilities SystemMetrics prints various system metrics TempDirToucher touches everything in a dir periodically to prevent deletion by /tmp cleaners Context global subsystem configuration SpawningKit Low-level subsystem specialized in spawning application processes. Factory given a spawn method and language name, creates appropriate Spawner object Direct Spawner implements "direct" spawn method Smart Spawner implements "smart" spawn method <<abstract>> Spawner main subsystem interface Result info about a spawned process; returned by Spawner Error Renderer given a spawn exception, generates HTML error page Exceptions relevant exception classes User Switching Rules figures out which user an app should run as HandshakePrepare implements the preparation phase of the spawn flow Config config of a single spawn operation BackgroundIO Capturer runs in a thread & captures all subprocess output in a string Session working state of a single spawn operation Public interface Internals Spawning protocol logic Utilities

18. Passenger agent Config Core ApiServer Controller main request handling server Security Update Checker Telemetry Collector Contains most Passenger business logic. Manages processes, routes requests. Config ApiServerCoreWatcher InstanceDir Toucher Watchdog Starts and supervises the Core. ApplicationPool Pool main subsystem interface Options collection of app config; collection of parameters for a get() call Session represents a single request/response session with a specific process Group represents an app; a collection of processes Process represents a single app process Socket represents a server socket endpoint that a process listens on Context global subsystem configuration Public interface Internals Abstracts application process spawning and management logic into a simple API. Keeps track of processes and related statistics. SpawnEnvSetupper Exec wrapper used by SpawningKit. Sets up the process environment, then executes the actual application command. ExecHelper executes a command as a specific user, similar to sudo Utilities SystemMetrics prints various system metrics TempDirToucher touches everything in a dir periodically to prevent deletion by /tmp cleaners Context global subsystem configuration SpawningKit Low-level subsystem specialized in spawning application processes. Factory given a spawn method and language name, creates appropriate Spawner object Direct Spawner implements "direct" spawn method Smart Spawner implements "smart" spawn method <<abstract>> Spawner main subsystem interface Result info about a spawned process; returned by Spawner Error Renderer given a spawn exception, generates HTML error page Exceptions relevant exception classes User Switching Rules figures out which user an app should run as HandshakePrepare implements the preparation phase of the spawn flow Config config of a single spawn operation BackgroundIO Capturer runs in a thread & captures all subprocess output in a string Session working state of a single spawn operation Public interface Internals Spawning protocol logic Utilities Three  layers!

19. Config Core ApiServer Controller main request handling server Security Update Checker Telemetry Collector Contains most Passenger business logic. Manages processes, routes requests. ApplicationPool Pool main subsystem interface Options collection of app config; collection of parameters for a get() call Session represents a single request/response session with a specific process Group represents an app; a collection of processes Process represents a single app process Socket represents a server socket endpoint that a process listens on Context global subsystem configuration Public interface Internals Abstracts application process spawning and management logic into a simple API. Keeps track of processes and related statistics. Passenger agent

20. Config Core ApiServer Controller main request handling server Security Update Checker Telemetry Collector Contains most Passenger business logic. Manages processes, routes requests. ApplicationPool Pool main subsystem interface Options collection of app config; collection of parameters for a get() call Session represents a single request/response session with a specific process Group represents an app; a collection of processes Process represents a single app process Socket represents a server socket endpoint that a process listens on Context global subsystem configuration Public interface Internals Abstracts application process spawning and management logic into a simple API. Keeps track of processes and related statistics. Passenger agent

21. Context global subsystem configuration SpawningKit Low-level subsystem specialized in spawning application processes. Factory given a spawn method and language name, creates appropriate Spawner object Direct Spawner implements "direct" spawn method Smart Spawner implements "smart" spawn method <<abstract>> Spawner main subsystem interface Result info about a spawned process; returned by Spawner Error Renderer given a spawn exception, generates HTML error page Exceptions relevant exception classes User Switching Rules figures out which user an app should run as HandshakePrepare implements the preparation phase of the spawn flow HandshakePerform implements the waiting & response phase of the spawn flow Journey keeps track of spawn operation progress Config config of a single spawn operation PipeWatcher runs in a thread & logs all subprocess output BackgroundIO Capturer runs in a thread & captures all subprocess output in a string Session working state of a single spawn operation WorkDir temp dir for a single spawn operation, used to communicate with the subprocess Public interface Internals Spawning protocol logic Utilities

29. Detailed  implementation  plan

30. 5.3.0 Foundation already laid in Implemented generic spawn flow

31. SpawningKit:: DirectSpawner Language wrapper Ruby: rack-loader Python: wsgi-loader Node.js: nodejs-loader HandshakePrepare: - create work dir (temp dir) - dump config into a file in work dir (JSON) create new process - load config from work dir - load app (e.g. config.ru, index.js) - setup other behavior (e.g. stats collection) - setup internal server finish signal, internal server address return process info to caller e.g. socket address Passenger application spawn flow (simplified): auto-supported apps

37. Normal flow [DONE] Generic flow Up next:

38. SpawningKit:: DirectSpawner Application HandshakePrepare: - create work dir (temp dir) - find free port - dump config into a file in work dir (JSON) create new process return process info to caller e.g. socket address Passenger application spawn flow (simplified): generic apps - initialization - setup server socket ... ... SpawningKit notices that port is now in use Mechanism introduced in 5.3.0!  But not exposed to users.

39. SpawningKit:: DirectSpawner Application HandshakePrepare: - create work dir (temp dir) - find free port - dump config into a file in work dir (JSON) create new process return process info to caller e.g. socket address Passenger application spawn flow (simplified): generic apps - initialization - setup server socket ... ... SpawningKit notices that port is now in use

42. Goal Build the mechanisms needed to activate generic spawn flow

43. PLAN Integration mode frontend Core Controller Core ApplicationPool • Add user config (e.g. passenger_app_start_command) • Process info from web server  -OR-  Perform our own autodetection (Standalone+builtin) • Pass necessary info to ApplicationPool Web server • Autodetect whether auto-supported or generic app • Pass necessary info to Core Controller • Modify Options class to support the new config options • Properly configure SpawningKit • Kill generic process upon shutdown

48. CONFIG TO ACTIVATE EACH SPAWNINGKIT FLOW Generic Auto-supported genericApp = true startsUsingWrapper irrelevant appType irrelevant startupFile irrelevant appStartCommand = [user-provided] genericApp = false, startsUsingWrapper = true, appType = (ruby,python,nodejs), startupFile = (autodetected/user-provided), appStartCommand = (path to interpreter) (path to wrapper)

49. Time to code!

50. Join the discussion on Github! Thanks for watching! https://github.com/phusion/passenger/issues/2135

Passenger 6 generic language support presentation

More Related Content

What's hot (20)

Similar to Passenger 6 generic language support presentation (20)

Recently uploaded (20)

Passenger 6 generic language support presentation