If your computer is cloud what its Operating System look like?
0 likes415 views
The document discusses the disruptive potential of serverless computing and argues for a radical rethinking of key concepts such as operating systems, programming, and application development to fully harness this technology. It details the components and architecture of a cloud AI operating system (CAIOS) aimed at improving software development for next-generation cloud environments. The author, Asher Sterkin, emphasizes the inadequacy of existing tools and the necessity for new approaches in cloud computing.
If your computer is cloud what its Operating System look like?
- 1. © BST LABS 2020 ALL RIGHTS RESERVED If your computer is cloud What its Operating System should look like? Asher Sterkin General Manager Follow up discussion of the Medium article:
- 2. 2© BST LABS 2020 ALL RIGHTS RESERVED About Myself ● Software Technologist (40 years in the field) ● SVP Engineering at Black Swan Technologies ● General Manager of BST LABS ● Acting Chief Programmer of the CAIOS project ● Former Distinguished Engineer at Cisco Engineering OCTO ● Former VP Technologies at NDS (acquired by Cisco in 2012) ● Contacts: ○ Medium ○ Slideshare ○ Linkedin ○ Twitter ○ E-mail
- 3. 3© BST LABS 2020 ALL RIGHTS RESERVED Major Article Claims ● Serverless it’s a truly disruptive technology ● Existing mainstream tools are inadequate for serverless ● To utilize its full potential a radical rethinking is required: ○ What is Computer? ○ What is Programming? ○ What is an Operating System? ○ What is Middleware? ○ What is Application? ○ What is Testing? ○ What is Source Code Management? ○ What is Productivity? ○ What is Quality? This talk
- 4. 4© BST LABS 2020 ALL RIGHTS RESERVED Disruptive Technology... Overshoot regular user needs at expense of convenience. Most of the time, Big Data is not that big.
- 5. 5© BST LABS 2020 ALL RIGHTS RESERVED Radical Rethinking ... Daniel Kim, “The 3rd Generation Leadership Challenge”, Keynote at Systems Thinking in Action 2010 Serverless disruption “Gentlemen, the telephone system of the United States was destroyed last night.”
- 6. 6© BST LABS 2020 ALL RIGHTS RESERVED What is Cloud Computer?
- 7. 7© BST LABS 2020 ALL RIGHTS RESERVED One region of one account of one vendor Region (host) Region (host) Managed AI Services Managed AI Services CF Stack (resource group) App Repository Code Repository API API
- 8. 8© BST LABS 2020 ALL RIGHTS RESERVED Control Unit ALU Mid-speed Block K/V or Heap Memory Slow Bulk K/V or Heap Memory Mid-speed Tabular Memory Slow Tabular Memory External Interfacing (ports) High Throughput Bus (Push) High Throughput Bus (Pull) Low-latency Pub/Sub Direct Connection Async Pipe Component Repository Component Configuration Telemetry Hierarchical Memory Access Control Encryption MLU DFU Cloud AI Computer “Hardware” Specification Immutable Ledger Memory zero trust replication
- 9. 9© BST LABS 2020 ALL RIGHTS RESERVED What Cloud Computer Programming is?
- 10. 10© BST LABS 2020 ALL RIGHTS RESERVED Domain-Specific “Virtual” Machine Development Down/Top Bottom/Up What we have (“hardware”) Intermediate translation (“in terms of”) What we need (“application”) Media Plane Control Plane MediaPlane ControlPlane
- 11. 11© BST LABS 2020 ALL RIGHTS RESERVED MediaPlaneControlPlane Internet Ports step_1 if step_N Control Flow Data Flow (a + b)/c (a or b) and c Memory Memory AI Services Control vs Data Plane load/store load/store compute handle Logic Logic (a + b)/c (a or b) and c
- 12. 12© BST LABS 2020 ALL RIGHTS RESERVED What Cloud Operating System is?
- 13. 13© BST LABS 2020 ALL RIGHTS RESERVED <<layer>> Application <<layer>> Framework <<layer>> Middleware <<layer>> Operating System <<layer>> Drivers ● Optimal Resource Utilization of one Computer ● Hardware Abstraction ● Security ● Productivity ● Scaling Up ● Inter-process Communication ● Optimal Resource Utilization of Distributed System ● Data Replication ● Scaling Out ● High-availability ● Optimal distribution ● Standard Library ● Cloud Flow Programming Compiler ● Cloud Vendor SDK & Development Tools Optimal Resource Utilization
- 14. 14© BST LABS 2020 ALL RIGHTS RESERVED Operational Statistics Coroutine (Fiber, Green Thread) POSIX Thread OS Process Container State Machine Flow Stage Specification Basic Primitives: ● Standard Library ● Custom Extensions Intermediate Representation Platform-Specific Representation Translation Code Generation and Optimization Optimization Models Machine Learning Concurrency Structure Optimization Optimization Target: minimal cost Constraints: ● latency SLA ● IP protection
- 15. 15© BST LABS 2020 ALL RIGHTS RESERVED Computation Unit Structure Optimization Secure Package Repository Certified 3rd party and in-house developed caios-py-import Computation Unit Initial Configuration: development/unit testing Operational Statistics Optimization Models Machine Learning Secure Package Repository Certified 3rd party and in-house developed caios-py-import Computation Unit Optimal Packaging Structure shared private Optimization Target: minimal cost Constraints: ● latency SLA ● IP protection
- 16. 16© BST LABS 2020 ALL RIGHTS RESERVED Cloud AI Operating System (CAIOS) leapfrogs software development languages and tools for the next generation of cloud Cloud AI Operating System (CAIOS)
- 17. © BST LABS 2020 ALL RIGHTS RESERVED Questions?