How to keep control and safety in the clouds
0 likes367 views
1. The document discusses different infrastructure types and their characteristics in terms of runtime, storage, security, and time to market. 2. It also discusses serverless benefits and disadvantages, and argues that serverless is not suitable for all applications due to statelessness and other issues. 3. The document proposes a layered architecture approach with microservices and mechanisms for request isolation through various levels of virtualization and containerization.
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
toString().padStart(width) : cell.padEnd(width); }).join(''))).join
}; const proportion = (max, val) => Math.round(val * 100 / max); co
calcProportion = table => { table.sort((row1, row2) => row2[DENSITY
row1[DENSITY_COL]); const maxDensity = table[0][DENSITY_COL]; table
forEach(row => { row.push(proportion(maxDensity, row[DENSITY_COL]))
return table; }; const getDataset = file => { const lines = fs.read
FileSync(file, 'utf8').toString().split('n'); lines.shift(); lines
return lines.map(line => line.split(',')); }; const main = compose
(getDataset, calcProportion, renderTable); const fs = require('fs'
compose = (...funcs) => x => funcs.reduce((x, fn) => fn(x), x); con
DENSITY_COL = 3; const renderTable = table => { const cellWidth = [
8, 8, 18, 6]; return table.map(row => (row.map((cell, i) => { const
= cellWidth[i]; return i ? cell.toString().padStart(width) : cell.p
(width); }).join(''))).join('n'); }; const proportion = (max, val)
How to keep control and
safety in the clouds
Timur Shemsedinov
github.com/tshemsedinov
Chief Software Architect at Metarhia
Lecturer at Kiev Polytechnic Institute
DX DAY 2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-1-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
From Infrastructure to Applications
DX DAY
2019
Hardware
Infrastructure
Application
State
Functions
Hardware
Infrastructure
Application
X
Functions](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-2-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Infrastructure Types
Infra Runtime Storage
● Bare metal none stateful stateful
● Shared hosting slice stateless stateful
● Virtualization slice stateful stateful
● Containerization slice stateful stateful
● Clusterization join stateful stateless
● Serverless join stateless stateless
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-3-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Infrastructure Aspects
Sec Lock TTM
● Bare metal ++++ no +
● Shared hosting + tech ++
● Virtualization +++ no +++
● Containerization +++ tech +++
● Clusterization +++ tech ++++
● Serverless ++ vendor +++++
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-4-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Serverless Benefits
● Service price? (evangelists told us...)
● Efficiency: Performance? Speed? Latency?
● Easy to test, deploy, maintain?
● Security? Reliability? Flexibility? Quality?
● Quick development?
● Reduces development cost?
● Scalability?
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-5-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
What we pay for?
We pay for:
● lack of available professionals
● lack of competencies
● lack of available technologies
● lack of funding for our projects
● lack of time
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-6-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
What can be automated?
Yes
● Infrastructure
● Monitoring
● Networking
● Integration (CI)
● Deployment (CD)
No
● Scalability, sharding
● Performance
● Quality
● Security
● Interactivity
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-7-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Cost Optimization Cases
● Small services, sometimes cold
Can reduce cost x10 (great: $10 to $1)
● Highload >100k online, always warm
Single bare metal can hold load
Try to calculate serverless cost...
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-8-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Serverless Disadvantages
● High resource consumption
● Stateless nature
● Interactivity issue (separate solution needed)
● No application integrity
● Development and debug issues
● Deploy and maintain issues
● Vendor lock, not open source
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-9-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Layered Architecture
Server-side
● Layered
● Microservices
● Serverless
Database
Data Access Layer
Business-logic
API
Network
DX DAY
2019
Client UI](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-10-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
What do we want?
● Apps consolidation
● Stateful cloud applications
● Interactivity (Websockets, TCP, TLS support)
● No vendor lock
● Private clouds
● Do not overpay for clouds
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-11-320.jpg)
![● Architecture and layered approach
● Async I/O for business-logic parallelization
● Long-lived processes: in-memory, reuse
● Server inside application (not vice versa)
● Minimize IPC and serialization
● Open source
● But we need request isolation
const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
How do we achieve this?
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-12-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Why Isolation?
● Errors, crashes
● Memory leaks and other resources
● Application: data, database connections
● File system and root directory
● OS environment, PID, IPC
● OS Security: users, groups
● Networking: socket descriptors, ports, hosts
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-13-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Isolation: Virtualization
Hardware
OS
Hypervisor
OS
App
OS
App
OS
App
OS
App
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-14-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Isolation: Containerization
Hardware
OS
Containers
App App App App App App App
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-15-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Microisolation
Hardware
OS
App Server App
App
App
App
App
App
App
App
App
AppAppAppAppApp
AppApp
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-16-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Isolation Levels (for Node.js)
● Hardware segmentation, Servers
● Virtual machine (hypervisor)
● Container (docker)
● Process (node)
● Thread (worker_threads)
● Sandbox (vm.createContext, vm.Script)
● Software context (object, closure)
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-17-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
SOA Architecture
DB
API
+
BL
Network
API
+
BL
API
+
BL
API
+
BL
Database
Data Access Layer
Business-logic
API
Network
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-18-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Microservices Architecture
DB
API
+
BL
Network
API
+
BL
API
+
BL
API
+
BL
Database
Data Access Layer
Business-logic
API
Network
DB DB DB
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-19-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Serverless Architecture
Database
API
+
BL
Network
API
+
BL
API
+
BL
API
+
BL
Database
Data Access Layer
Business-logic
API
Network
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-20-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Serverless Architecture
Database
API+BL
Network
Database
Data Access Layer
Business-logic
API
Network
API+BL
API+BL
API+BL
API+BL API+BL API+BL
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-21-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Serverless Architecture
Database
API+BL
Network
Database
Data Access Layer
Business-logic
API
Network
API+BL
API+BL
API+BL
API+BL API+BL API+BL
API+BL
API+BL API+BL
API+BL
API+BL
API+BL
API+BL
API+BL
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-22-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Serverless Architecture
Database
API+BL
Network
Database
Data Access Layer
Business-logic
API
Network
API+BL
API+BL
API+BL
API+BL API+BL API+BL
API+BL
API+BL API+BL
API+BL
API+BL
API+BL
API+BL
API+BL
API+BL
API+BL
API+BL
API+BL API+BL
API+BL API+BL API+BL
API+BL API+BL
API+BL
API+BL
API+BL
API+BL
API+BL
API+BL API+BL
API+BL
API+BL
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-23-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Metaserverless Experiments
● Application is not a separate functions,
application has distributed in-memory state
● Functions can be executed sequentially and
parallely in asynchronous style
● Applications have long life and structure
● Interactivity (Websockets, TCP, TLS support)
● No vendor lock, Private clouds, Open Source](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-24-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Vendor Lock Prevention Checklist
● Wrap vendor services
● Concentrate on architecture: layers
● Code quality and competencies
● Think twice before following hype and trends
● Remove dependencies if possible
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-25-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
Vendor Loyalty Checklisk
● Use everything as a service
● Follow guidelines
● Сut risky developments
● Relax
● Share your income
DX DAY
2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-26-320.jpg)
![const fs = require('fs'); const compose = (...funcs) => x => funcs.
reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab
table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma
=> (row.map((cell, i) => { const width = cellWidth[i]; return i ? c
toString().padStart(width) : cell.padEnd(width); }).join(''))).join
}; const proportion = (max, val) => Math.round(val * 100 / max); co
calcProportion = table => { table.sort((row1, row2) => row2[DENSITY
row1[DENSITY_COL]); const maxDensity = table[0][DENSITY_COL]; table
forEach(row => { row.push(proportion(maxDensity, row[DENSITY_COL]))
return table; }; const getDataset = file => { const lines = fs.read
FileSync(file, 'utf8').toString().split('n'); lines.shift(); lines
return lines.map(line => line.split(',')); }; const main = compose
(getDataset, calcProportion, renderTable); const fs = require('fs'
compose = (...funcs) => x => funcs.reduce((x, fn) => fn(x), x); con
DENSITY_COL = 3; const renderTable = table => { const cellWidth = [
8, 8, 18, 6]; return table.map(row => (row.map((cell, i) => { const
= cellWidth[i]; return i ? cell.toString().padStart(width) : cell.p
(width); }).join(''))).join('n'); }; const proportion = (max, val)
How to keep control and
safety in the clouds
Timur Shemsedinov
github.com/tshemsedinov
Chief Software Architect at Metarhia
Lecturer at Kiev Polytechnic Institute
DX DAY 2019](https://image.slidesharecdn.com/dx-day-2019-serverless-191025160845/85/How-to-keep-control-and-safety-in-the-clouds-27-320.jpg)
How to keep control and safety in the clouds
- 1. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c toString().padStart(width) : cell.padEnd(width); }).join(''))).join }; const proportion = (max, val) => Math.round(val * 100 / max); co calcProportion = table => { table.sort((row1, row2) => row2[DENSITY row1[DENSITY_COL]); const maxDensity = table[0][DENSITY_COL]; table forEach(row => { row.push(proportion(maxDensity, row[DENSITY_COL])) return table; }; const getDataset = file => { const lines = fs.read FileSync(file, 'utf8').toString().split('n'); lines.shift(); lines return lines.map(line => line.split(',')); }; const main = compose (getDataset, calcProportion, renderTable); const fs = require('fs' compose = (...funcs) => x => funcs.reduce((x, fn) => fn(x), x); con DENSITY_COL = 3; const renderTable = table => { const cellWidth = [ 8, 8, 18, 6]; return table.map(row => (row.map((cell, i) => { const = cellWidth[i]; return i ? cell.toString().padStart(width) : cell.p (width); }).join(''))).join('n'); }; const proportion = (max, val) How to keep control and safety in the clouds Timur Shemsedinov github.com/tshemsedinov Chief Software Architect at Metarhia Lecturer at Kiev Polytechnic Institute DX DAY 2019
- 2. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c From Infrastructure to Applications DX DAY 2019 Hardware Infrastructure Application State Functions Hardware Infrastructure Application X Functions
- 3. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Infrastructure Types Infra Runtime Storage ● Bare metal none stateful stateful ● Shared hosting slice stateless stateful ● Virtualization slice stateful stateful ● Containerization slice stateful stateful ● Clusterization join stateful stateless ● Serverless join stateless stateless DX DAY 2019
- 4. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Infrastructure Aspects Sec Lock TTM ● Bare metal ++++ no + ● Shared hosting + tech ++ ● Virtualization +++ no +++ ● Containerization +++ tech +++ ● Clusterization +++ tech ++++ ● Serverless ++ vendor +++++ DX DAY 2019
- 5. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Serverless Benefits ● Service price? (evangelists told us...) ● Efficiency: Performance? Speed? Latency? ● Easy to test, deploy, maintain? ● Security? Reliability? Flexibility? Quality? ● Quick development? ● Reduces development cost? ● Scalability? DX DAY 2019
- 6. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c What we pay for? We pay for: ● lack of available professionals ● lack of competencies ● lack of available technologies ● lack of funding for our projects ● lack of time DX DAY 2019
- 7. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c What can be automated? Yes ● Infrastructure ● Monitoring ● Networking ● Integration (CI) ● Deployment (CD) No ● Scalability, sharding ● Performance ● Quality ● Security ● Interactivity DX DAY 2019
- 8. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Cost Optimization Cases ● Small services, sometimes cold Can reduce cost x10 (great: $10 to $1) ● Highload >100k online, always warm Single bare metal can hold load Try to calculate serverless cost... DX DAY 2019
- 9. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Serverless Disadvantages ● High resource consumption ● Stateless nature ● Interactivity issue (separate solution needed) ● No application integrity ● Development and debug issues ● Deploy and maintain issues ● Vendor lock, not open source DX DAY 2019
- 10. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Layered Architecture Server-side ● Layered ● Microservices ● Serverless Database Data Access Layer Business-logic API Network DX DAY 2019 Client UI
- 11. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c What do we want? ● Apps consolidation ● Stateful cloud applications ● Interactivity (Websockets, TCP, TLS support) ● No vendor lock ● Private clouds ● Do not overpay for clouds DX DAY 2019
- 12. ● Architecture and layered approach ● Async I/O for business-logic parallelization ● Long-lived processes: in-memory, reuse ● Server inside application (not vice versa) ● Minimize IPC and serialization ● Open source ● But we need request isolation const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c How do we achieve this? DX DAY 2019
- 13. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Why Isolation? ● Errors, crashes ● Memory leaks and other resources ● Application: data, database connections ● File system and root directory ● OS environment, PID, IPC ● OS Security: users, groups ● Networking: socket descriptors, ports, hosts DX DAY 2019
- 14. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Isolation: Virtualization Hardware OS Hypervisor OS App OS App OS App OS App DX DAY 2019
- 15. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Isolation: Containerization Hardware OS Containers App App App App App App App DX DAY 2019
- 16. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Microisolation Hardware OS App Server App App App App App App App App App AppAppAppAppApp AppApp DX DAY 2019
- 17. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Isolation Levels (for Node.js) ● Hardware segmentation, Servers ● Virtual machine (hypervisor) ● Container (docker) ● Process (node) ● Thread (worker_threads) ● Sandbox (vm.createContext, vm.Script) ● Software context (object, closure) DX DAY 2019
- 18. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c SOA Architecture DB API + BL Network API + BL API + BL API + BL Database Data Access Layer Business-logic API Network DX DAY 2019
- 19. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Microservices Architecture DB API + BL Network API + BL API + BL API + BL Database Data Access Layer Business-logic API Network DB DB DB DX DAY 2019
- 20. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Serverless Architecture Database API + BL Network API + BL API + BL API + BL Database Data Access Layer Business-logic API Network DX DAY 2019
- 21. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Serverless Architecture Database API+BL Network Database Data Access Layer Business-logic API Network API+BL API+BL API+BL API+BL API+BL API+BL DX DAY 2019
- 22. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Serverless Architecture Database API+BL Network Database Data Access Layer Business-logic API Network API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL DX DAY 2019
- 23. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Serverless Architecture Database API+BL Network Database Data Access Layer Business-logic API Network API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL API+BL DX DAY 2019
- 24. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Metaserverless Experiments ● Application is not a separate functions, application has distributed in-memory state ● Functions can be executed sequentially and parallely in asynchronous style ● Applications have long life and structure ● Interactivity (Websockets, TCP, TLS support) ● No vendor lock, Private clouds, Open Source
- 25. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Vendor Lock Prevention Checklist ● Wrap vendor services ● Concentrate on architecture: layers ● Code quality and competencies ● Think twice before following hype and trends ● Remove dependencies if possible DX DAY 2019
- 26. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c Vendor Loyalty Checklisk ● Use everything as a service ● Follow guidelines ● Сut risky developments ● Relax ● Share your income DX DAY 2019
- 27. const fs = require('fs'); const compose = (...funcs) => x => funcs. reduce((x, fn) => fn(x), x); const DENSITY_COL = 3; const renderTab table => { const cellWidth = [18, 10, 8, 8, 18, 6]; return table.ma => (row.map((cell, i) => { const width = cellWidth[i]; return i ? c toString().padStart(width) : cell.padEnd(width); }).join(''))).join }; const proportion = (max, val) => Math.round(val * 100 / max); co calcProportion = table => { table.sort((row1, row2) => row2[DENSITY row1[DENSITY_COL]); const maxDensity = table[0][DENSITY_COL]; table forEach(row => { row.push(proportion(maxDensity, row[DENSITY_COL])) return table; }; const getDataset = file => { const lines = fs.read FileSync(file, 'utf8').toString().split('n'); lines.shift(); lines return lines.map(line => line.split(',')); }; const main = compose (getDataset, calcProportion, renderTable); const fs = require('fs' compose = (...funcs) => x => funcs.reduce((x, fn) => fn(x), x); con DENSITY_COL = 3; const renderTable = table => { const cellWidth = [ 8, 8, 18, 6]; return table.map(row => (row.map((cell, i) => { const = cellWidth[i]; return i ? cell.toString().padStart(width) : cell.p (width); }).join(''))).join('n'); }; const proportion = (max, val) How to keep control and safety in the clouds Timur Shemsedinov github.com/tshemsedinov Chief Software Architect at Metarhia Lecturer at Kiev Polytechnic Institute DX DAY 2019