Web APIs in Node.js Core: Past, Present, and Future (JSConf EU 2019)
0 likes325 views
Node.js has added several web APIs to its core over time, including console, encoding, timers, microtask queuing, URL, and Workers. More may be added in the future after consensus seeking and ensuring they are optimized for Node.js use cases. The process involves proposing features, fixing bugs, adding tests, and potentially moving APIs out of experimental status and into stable releases. Keeping Node.js APIs aligned with open web standards presents ongoing challenges and opportunities.
Web APIs in Node.js Core: Past, Present, and Future (JSConf EU 2019)
- 1. Web APIs in Node.js Core Past, Present, and Future Joyee Cheung, Igalia JSConf EU 2019
- 2. About Me • Joyee Cheung / Qiuyi Zhang (张秋怡) • Lives in Hangzhou (杭州) • Compilers team, Igalia • Node.js TSC • joyeecheung @ GitHub/Twitter
- 3. Web APIs in Node.js core?
- 4. Browser APIs as Node.js built-ins
- 5. JavaScript in the wild JS Engines ECMA TC39 Date Regexp Error
- 6. JavaScript in the wild EventTarget Browsers W3C / WHATWG JS Engines ECMA TC39 Date Regexp Error setTimeout()
- 7. JavaScript in the wild EventTarget EventEmitterDate Regexp Error Browsers W3C / WHATWG Node.js Core JS Engines ECMA TC39 setTimeout()
- 8. JavaScript in the wild EventTarget ReadableStream EventEmitter Readable querystring Date Regexp SubtleCryto crypto Error Browsers W3C / WHATWG Node.js Core JS Engines ECMA TC39 setTimeout()URLSearchParams
- 9. JavaScript in the wild EventTarget ReadableStream EventEmitter Readable querystring Date Regexp SubtleCryto crypto Error Browsers W3C / WHATWG Node.js Core JS Engines ECMA TC39 setTimeout() URLSearchParams
- 10. JavaScript APIs on the Web (Browsers)
- 11. JavaScript APIs in Node.js
- 13. And we have tests!
- 14. WPT conformance in Node.js
- 15. Implemented in Node.js first (experimental) https://html.spec.whatwg.org/multipage/webappapis.html#creating-a-json-module-script
- 16. Alternatives in Node.js CoreAlternatives in Node.js Core URL/URLSearchParams Text{En,De}coder url/querystring Buffer/StringDecoder Web Node.js performance Timing methods in process
- 17. Alternatives in Node.js CoreAlternatives in Node.js Core URL/URLSearchParams Text{En,De}coder performance queueMicrotask() process.nextTick() url/querystring Buffer/StringDecoder Timing methods in process Be careful… Web Node.js
- 18. Alternatives in Node.js CoreAlternatives in Node.js Core URL/URLSearchParams Text{En,De}coder Worker performance queueMicrotask() process.nextTick() url/querystring Buffer/StringDecoder child_process Timing methods in process Be careful… Web Node.js
- 19. Web APIs in Node.js v12 Stable console Timers e.g. setTimeout() URL/URLSearchParams TextEncoder/TextDecoder queueMicrotask() Globals Covered by WPT with some expected failures
- 20. Web APIs in Node.js v12 worker_thread.Worker perf_hooks.performance Stable Experimental console Timers e.g. setTimeout() URL/URLSearchParams TextEncoder/TextDecoder queueMicrotask() Under builtin modules Not global Differs significantly No WPT coverage yet
- 21. WebAssembly Implemented by V8 Web APIs in Node.js v12 worker_thread.Worker perf_hooks.performance Stable Experimental console Timers e.g. setTimeout() URL/URLSearchParams TextEncoder/TextDecoder queueMicrotask()
- 22. Web APIs haunting the issue tracker…
- 23. Web APIs haunting the issue tracker… Web APIs under discussion
- 24. Web APIs under discussion • Stream • https://github.com/nodejs/whatwg-stream
- 25. Web APIs under discussion • Stream • https://github.com/nodejs/whatwg-stream Stream 1 Push
- 26. Web APIs under discussion • Stream • https://github.com/nodejs/whatwg-stream Stream 1 Stream 2 Push Push/Pull
- 27. Web APIs under discussion • Stream • https://github.com/nodejs/whatwg-stream Stream 1 Stream 2 Stream 3 Push Push/Pull Push+Pull
- 28. Web APIs under discussion • Stream • https://github.com/nodejs/whatwg-stream Stream 1 Stream 2 Stream 3 bob (dev) Push Push/Pull Push+Pull Pull
- 29. Web APIs under discussion • Stream • https://github.com/nodejs/whatwg-stream Stream 1 Stream 2 Stream 3 bob (dev) Push Push/Pull Push+Pull Pull WHAWG?
- 30. Web APIs under discussion • Stream • https://github.com/nodejs/whatwg-stream • Fetch • https://github.com/nodejs/summit/issues/165 • New! https://github.com/nodejs/node/pull/27979
- 31. Web APIs in Node.js Core! …But why?
- 32. Web APIs in Node.js Core!
- 33. Web APIs in Node.js Core! 🤔
- 34. Web APIs in Node.js Core! 🤓
- 35. Web APIs in Node.js Core! Maintenance and longevity
- 36. Web APIs in Node.js Core?
- 37. Web APIs in Node.js Core? Consensus Seeking https://github.com/nodejs/TSC/blob/master/TSC-Charter.md
- 38. Web APIs in Node.js Core? Small core philosophy
- 39. Web APIs in Node.js Core? Small core philosophy • Duplicate API for a similar set of functionality • While missing features that do not make sense for browsers
- 40. Web APIs in Node.js Core? Small core philosophy • Duplicate API for a similar set of functionality • While missing features that do not make sense for browsers • In core or as separate “official” modules? • Optimizability • Dependency on internals
- 41. Web APIs in Node.js Core? More than just a bunch of interfaces
- 42. Web APIs in Node.js Core? https://foo.com/script.js https://bar.com/api Origin: https://foo.com Cookie: TOKEN=XXX Access-Control-Allow-Origin: https://foo.comBrowsers More than just a bunch of interfaces
- 43. Web APIs in Node.js Core? More than just a bunch of interfaces We don’t really have an origin ATM.. ./node_modules/foo/script.js https://bar.com/api Access-Control-Allow-Origin: https://foo.comNode.js Origin: https://foo.com Cookie: TOKEN=XXX
- 44. Web APIs in Node.js Core? fetch() CORS Caching Content Security Policy Service workers Credentials e.g. Cookies
- 45. Web APIs in Node.js Core? User land migration • Different vocabulary WHATWG Streams EventTarget require (‘stream’) EventEmitter fetch() http.request()
- 46. Web APIs in Node.js Core? User land migration • Different vocabulary • Interoperability with other modules WHATWG Streams EventTarget require (‘stream’) EventEmitter fetch() http.request()
- 47. Web APIs in Node.js Core? Open questions + consensus seeking
- 50. Typical Workflow Fork Pull Request masterFeature request ✘ ✘ e.g. WebCrypto https://github.com/nodejs/node/issues/19826
- 52. Typical Workflow Fork Pull Request master Fix bugs Add WPT* Expose as globals* OptimizeFeature request Upstream Spec / WPT * optional
- 53. Release Typical Workflow Fork Pull Request master Fix bugs Add WPT* Expose as globals* OptimizeFeature request Upstream Spec / WPT * optional Experimental e.g. Worker, performance
- 54. Typical Workflow Fork Pull Request master Fix bugs Add WPT* Expose as globals* Optimize Move out of experiment* Release RFC / Feature request Upstream Spec / WPT * optional Stable e.g. URL, TextEncoder/TextDecoder
- 55. Summary • Past • Node.js core APIs diverged from Web APIs for different design goals • Node.js has added more and more Web APIs • Present • console, encoding, timer, microtask queuing, URL, Workers, performance, WebAssembly • Future • Challenges and workflow
- 56. Node.js & Open Standards
- 57. Thank you!