SlideShare a Scribd company logo
2
Most read
Craft Demonstration
Jimmy Malhan
Agenda
● Demo aka Final Output
○ In-process work on Case Study (fun part)
● Bonuses
● Other ways & production scenario
Demo
● My understanding on case study
○ issues?
○ queries on approach for case study (with recruiter)
● Showtime:
○ DNS name of the running server as final output.
○ Python Code - CMD line tool
○ Docker Images - package cmd line to container
○ K8s - deployed locally with “Job” using stack outputs
CloudFormation Stack
Bonuses
● Script:
○ Tags parameters (--tags=key=value)
○ Log Parameters (--log=key=value) by default=INFO
● Stack
○ Monitoring
○ Top off k8s and docker’s best practices based on config
Other Ways
● Infrastructure
○ HardWay - Create script from scratch - (time consuming, test API &
cleanup thoroughly in the end).
○ CF way - Could also tried Nested Stacks- modify the template to
export the output defined values.
○ TF- state files (s3), lock files (dynamodb), create module on resource.
Other Ways
● Application
○ Build application inside the container.
○ Container as often overlooked for one-time setup.
○ Non-parameter way vs Docker file vs K8s Secrets.
Production Scenario
● Make it multi-container :
○ Maintenance page with nginx.
○ Logs collector (fluentd, splunk, CW, DataDog, nginx monitoring etc).
○ ClamAv & Prisma alerts for container scanning.
● Let’s do CICD:
○ Assume Role
○ Stages - Test, Publish, Release, Kill/Destroy
Argo CD way
Production
Scenario

More Related Content

PPTX
Pymongo password change made easy
PDF
Making Data Timelier and More Reliable with Lakehouse Technology
PPTX
Text MIning
PDF
Common issues with Apache Kafka® Producer
PDF
Data Warehouses in Kubernetes Visualized: the ClickHouse Kubernetes Operator UI
PDF
The Parquet Format and Performance Optimization Opportunities
PDF
GraphFrames: Graph Queries In Spark SQL
PDF
Introduction To TensorFlow | Deep Learning Using TensorFlow | TensorFlow Tuto...
Pymongo password change made easy
Making Data Timelier and More Reliable with Lakehouse Technology
Text MIning
Common issues with Apache Kafka® Producer
Data Warehouses in Kubernetes Visualized: the ClickHouse Kubernetes Operator UI
The Parquet Format and Performance Optimization Opportunities
GraphFrames: Graph Queries In Spark SQL
Introduction To TensorFlow | Deep Learning Using TensorFlow | TensorFlow Tuto...

What's hot (20)

PPTX
Feature store: Solving anti-patterns in ML-systems
PDF
Generative AI: Shifting the AI Landscape
PDF
Emeli Dral (Evidently AI) – Analyze it: production monitoring for machine lea...
PDF
Observability for Data Pipelines With OpenLineage
PPTX
Federated Learning
PDF
Large Language Models - Chat AI.pdf
PPTX
LLM presentation final
PDF
Solving PostgreSQL wicked problems
PPTX
Data Lake Overview
PPT
3.2 partitioning methods
PDF
LanGCHAIN Framework
PDF
Enterprise guide to building a Data Mesh
PDF
Future of Data Strategy (ASEAN)
PPTX
What Is Apache Spark? | Introduction To Apache Spark | Apache Spark Tutorial ...
PDF
Seamless End-to-End Production Machine Learning with Seldon and MLflow
PDF
Data Product Architectures
PPTX
Amazon SageMaker for MLOps Presentation.
PDF
Data Mesh Part 4 Monolith to Mesh
PPTX
GPT, LLM, RAG, and RAG in Action: Understanding the Future of AI-Powered Info...
PDF
Data Science Across Data Sources with Apache Arrow
Feature store: Solving anti-patterns in ML-systems
Generative AI: Shifting the AI Landscape
Emeli Dral (Evidently AI) – Analyze it: production monitoring for machine lea...
Observability for Data Pipelines With OpenLineage
Federated Learning
Large Language Models - Chat AI.pdf
LLM presentation final
Solving PostgreSQL wicked problems
Data Lake Overview
3.2 partitioning methods
LanGCHAIN Framework
Enterprise guide to building a Data Mesh
Future of Data Strategy (ASEAN)
What Is Apache Spark? | Introduction To Apache Spark | Apache Spark Tutorial ...
Seamless End-to-End Production Machine Learning with Seldon and MLflow
Data Product Architectures
Amazon SageMaker for MLOps Presentation.
Data Mesh Part 4 Monolith to Mesh
GPT, LLM, RAG, and RAG in Action: Understanding the Future of AI-Powered Info...
Data Science Across Data Sources with Apache Arrow
Ad

Similar to Case Study (20)

PDF
Mastering Terraform and the Provider for OCI
PDF
Data pipelines from zero to solid
PDF
Etl confessions pg conf us 2017
PPTX
Revealing ALLSTOCKER
PDF
How to make data available for analytics ASAP
PDF
Test strategies for data processing pipelines
PDF
SANDcamp 2014 - A Perfect Launch, Every Time
PDF
Databricks: What We Have Learned by Eating Our Dog Food
PDF
Nexmark with beam
PDF
Kubernetes Workload Rebalancing
PDF
Terraforming your Infrastructure on GCP
PDF
Deeplearning in production
PPTX
Robust C++ Task Systems Through Compile-time Checks
PPTX
Exploiting GPU's for Columnar DataFrrames by Kiran Lonikar
PDF
Building an analytics workflow using Apache Airflow
PDF
6 Months Sailing with Docker in Production
PDF
Getting-Started-with-Containers-and-Kubernetes_-March-2020-CNCF-Webinar.pdf
PPTX
Lessons learned after a year of lambda - AWS Community Day SF 2017
ODP
UWE Linux Boot Camp 2007: Hacking embedded Linux on the cheap
PPTX
Go bei der 4Com GmbH & Co. KG
Mastering Terraform and the Provider for OCI
Data pipelines from zero to solid
Etl confessions pg conf us 2017
Revealing ALLSTOCKER
How to make data available for analytics ASAP
Test strategies for data processing pipelines
SANDcamp 2014 - A Perfect Launch, Every Time
Databricks: What We Have Learned by Eating Our Dog Food
Nexmark with beam
Kubernetes Workload Rebalancing
Terraforming your Infrastructure on GCP
Deeplearning in production
Robust C++ Task Systems Through Compile-time Checks
Exploiting GPU's for Columnar DataFrrames by Kiran Lonikar
Building an analytics workflow using Apache Airflow
6 Months Sailing with Docker in Production
Getting-Started-with-Containers-and-Kubernetes_-March-2020-CNCF-Webinar.pdf
Lessons learned after a year of lambda - AWS Community Day SF 2017
UWE Linux Boot Camp 2007: Hacking embedded Linux on the cheap
Go bei der 4Com GmbH & Co. KG
Ad

Recently uploaded (20)

PPTX
FINAL REVIEW FOR COPD DIANOSIS FOR PULMONARY DISEASE.pptx
PPTX
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
PDF
Automation-in-Manufacturing-Chapter-Introduction.pdf
DOCX
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
PPTX
UNIT 4 Total Quality Management .pptx
PDF
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
PPTX
Lecture Notes Electrical Wiring System Components
PDF
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
PPTX
Sustainable Sites - Green Building Construction
PPTX
CH1 Production IntroductoryConcepts.pptx
PPTX
OOP with Java - Java Introduction (Basics)
PPTX
bas. eng. economics group 4 presentation 1.pptx
PDF
composite construction of structures.pdf
PDF
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
PPTX
CYBER-CRIMES AND SECURITY A guide to understanding
PPTX
Geodesy 1.pptx...............................................
PDF
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
PPTX
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
PDF
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
PDF
Well-logging-methods_new................
FINAL REVIEW FOR COPD DIANOSIS FOR PULMONARY DISEASE.pptx
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
Automation-in-Manufacturing-Chapter-Introduction.pdf
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
UNIT 4 Total Quality Management .pptx
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
Lecture Notes Electrical Wiring System Components
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
Sustainable Sites - Green Building Construction
CH1 Production IntroductoryConcepts.pptx
OOP with Java - Java Introduction (Basics)
bas. eng. economics group 4 presentation 1.pptx
composite construction of structures.pdf
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
CYBER-CRIMES AND SECURITY A guide to understanding
Geodesy 1.pptx...............................................
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
Well-logging-methods_new................

Case Study

  • 2. Agenda ● Demo aka Final Output ○ In-process work on Case Study (fun part) ● Bonuses ● Other ways & production scenario
  • 3. Demo ● My understanding on case study ○ issues? ○ queries on approach for case study (with recruiter) ● Showtime: ○ DNS name of the running server as final output. ○ Python Code - CMD line tool ○ Docker Images - package cmd line to container ○ K8s - deployed locally with “Job” using stack outputs
  • 5. Bonuses ● Script: ○ Tags parameters (--tags=key=value) ○ Log Parameters (--log=key=value) by default=INFO ● Stack ○ Monitoring ○ Top off k8s and docker’s best practices based on config
  • 6. Other Ways ● Infrastructure ○ HardWay - Create script from scratch - (time consuming, test API & cleanup thoroughly in the end). ○ CF way - Could also tried Nested Stacks- modify the template to export the output defined values. ○ TF- state files (s3), lock files (dynamodb), create module on resource.
  • 7. Other Ways ● Application ○ Build application inside the container. ○ Container as often overlooked for one-time setup. ○ Non-parameter way vs Docker file vs K8s Secrets.
  • 8. Production Scenario ● Make it multi-container : ○ Maintenance page with nginx. ○ Logs collector (fluentd, splunk, CW, DataDog, nginx monitoring etc). ○ ClamAv & Prisma alerts for container scanning. ● Let’s do CICD: ○ Assume Role ○ Stages - Test, Publish, Release, Kill/Destroy

Editor's Notes

  • #2: keep sipping coffee..
  • #3: What have you brought on the table?
  • #4: Let’s check your code, docker images, K8s config?
  • #5: What’s CF Stack? How does your stack looks like?
  • #6: What else do I got?
  • #7: Any other way, could have done this?
  • #8: Any other way, could have done this?
  • #9: that was just local setup, what about production environment?
  • #10: Let’s not forget CICD!
  • #11: show me the architecture of the production scenario?