Cloud Infrastructure from Python Code: PyCon DE-23
0 likes65 views
The document discusses the potential of using Python code for cloud infrastructure, emphasizing the need for simplicity in development, deployment, and operation. It introduces the concept of 'Infrastructure from Code' (ifc) through the pyifc solution, aiming to empower Python developers by reducing complexity and vendor dependency. Key figures in this initiative include Asher Sterkin and Etzik Bega from Blackswan Technologies, highlighting their experience in cloud software and cybersecurity.
![PyCon DE - Pandas Vs Polars
6M record, 45 columns Parquet file
Stack creation completed after 00m 35s
Pandas[s]: 23.5803955450001 Polars[s]: 6.916807431000052
Local VM
AWS
Cloud](https://image.slidesharecdn.com/pyconde-23-230419132605-4e8d3cb1/85/Cloud-Infrastructure-from-Python-Code-PyCon-DE-23-33-320.jpg)
Cloud Infrastructure from Python Code: PyCon DE-23
- 1. Cloud Infrastructure from Python Code How far could we go? Asher Sterkin SVP Engineering, GM
- 2. Who is Asher Sterkin? â A Software Engineer since 1978 â SVP Engineering and GM @ BST LABS, BlackSwan Technologies â Technology lead of the Cloud AI Operating System (CAIOS) project â Contacts: â Asher Sterkin - Israel | Professional Profile | LinkedIn â Asher Sterkin (@asterkin) / Twitter â asher.sterkin@gmail.com â Slideshare: Asher Sterkin â Medium: Asher Sterkin â https://mastodon.social/@asterkin â https://www.reddit.com/user/ashersterkin
- 3. Disclaimer â We are senior managers of one of the IfC Products - CAIOS â Best effort to avoid direct marketing against competitors â It not an not official position of our employer BlackSwan Technologies â Specific examples use CAIOS for illustration purposes only â AWS icons usage is for illustration purposes only as well
- 4. âInfrastructure from Python Codeâ Mission âYour Computer is Cloudâ Ease of use Development Deployment Operation Cost Security Reliability Sustainability PyIFC Empowering mainstream Python programmers to develop, deploy, and operate cost-effective, secure, reliable, and sustainable cloud software without a hussle
- 5. These are questions we here over and over again
- 6. Why Python Developers should know Terraform?
- 7. In other words âŠ
- 8. Why couldnât we run Python code on cloud and not to worry about SDKs and templates?
- 10. Cognitive Overload Templates SDK â Low level of abstraction â Vendor-specific â Complicated â Error-, cost-, and security-prone â Special technical knowledge â Requires lot of coordination â Far from core business
- 11. Raise the Level, Bridge the Gap The IfC Solution
- 12. The PyIfC Solution PyIFC Service Configuration Logicâ Template â Cost-effective â Secure â Reliable â Sustainable
- 13. Build, release, run service.py service_config.py module.py build module.py function.py stack.json release <user-storage> run <service-stack> Based on port-to-resource binding specified in configuration: â Generate resource template descriptor(s) â Incorporate resource-specific out port adaptors to convert high-level application calls to resource SDK calls Warning: vendor-specific example
- 14. Live Demo âŠ
- 15. The need for infrastructure governance does not go anywhere. Yet, we could significantly lift up the level of abstraction and provide reasonable defaults to dramatically simplify the process without losing control. PyIFC
- 16. One Inch Depth Dive into PyIFC Machinery
- 17. I F C services vendors APIs location acquire configure consume operate 4 Pillars of the âInfrastructure From Codeâ Service Configuration
- 18. I F C APIs location acquire configure consume operate TODO Sample App service.py service_config.py services vendors
- 19. Where We Are Today and Where Could We Go?
- 20. IfC Technology Landscape nitric klotho nitric klotho caios nitric klotho vercel modal chalice cloudflare ampt nitric klotho cloudflare cloudflare wing dark nitric klotho vercel encore shuttle
- 21. frontend core backend extensions The Potential is Much Bigger
- 23. Open-end Architecture Application Logic Generic, Supportive, Core Subdomains Generic, Supportive, Core Subdomains Out of proc Sidecar In-proc extension Adapters
- 24. As far, as there is a market for this How Far Could We Go?
- 25. Let Python be Python What is Needed?
- 26. Protocols for PEPs and Standard Library
- 27. Protocols for Popular Open Source Solutions
- 28. Python IfC Objective Unlock full Python potential as a truly cloud-native programming language by adapting its runtime and compiler to work optimally with cloud resources Library Shelf
- 30. Who is Etzik Bega? â An Electrical Engineer since 1998, MBA since 2005 â VP Product @ BST LABS, BlackSwan Technologies â Product lead of the Cloud AI Operating System (CAIOS) project â 25 years of experience in cyber security and telecommunication â 3 years Chief security & privacy officer of BlackSwan Technologies â 2 years head of devops & finops at BlackSwan Technologies â Childrenâs book writer â Etzik Bega - Israel | Professional Profile | LinkedIn
- 31. I am not a software developer⊠Disclaimer
- 32. CAIOS Apps Security & Privacy Cost Optimization Observability HR Data Migration Data Processing Apps Written Average dev time (hours) Average code saving ratio 2 12 7 3 2 10 24 17 11 21 190 22 1/20 1/8 1/5 1/7 1/7 1/10 Total lines of code saved : 75988
- 33. PyCon DE - Pandas Vs Polars 6M record, 45 columns Parquet file Stack creation completed after 00m 35s Pandas[s]: 23.5803955450001 Polars[s]: 6.916807431000052 Local VM AWS Cloud
- 35. Contact: â www.caios.io â info@caios.io â Asher@blackswan-technologies.com â Etzik@blackswan-technologies.com
- 36. Questions