MLOps vs LLMOps (by workflows and use cases) - 2024-05-21
0 likes107 views
The document discusses the differences between MLOps and LLMOps, highlighting their respective methods, actors, and use cases such as forecasting, sentiment analysis, and chatbots. It provides a comparison of tools, training processes, monitoring practices, and evaluation metrics specific to MLOps and LLMOps. Key takeaways include the computing requirements and metrics evaluation differences between the two approaches.
![MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
LLMOps ● code
○ processing ++
○ [ training ] ++
○ inference ++
■ RAG
○ evaluation
● model & baselines
● embeddings ++
● prompt
● monitoring
○ metrics
○ logs
○ bias & malicious behaviors
■ training baseline vs new data
■ prediction baseline vs new pred
Resources versioned or
saved with a timestamp](https://image.slidesharecdn.com/mlops-240601105931-f502efd5/85/MLOps-vs-LLMOps-by-workflows-and-use-cases-2024-05-21-66-320.jpg)
MLOps vs LLMOps (by workflows and use cases) - 2024-05-21
- 1. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps vs LLMOps
- 2. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Alessandra Bilardi Data & Automation Specialist @ Corley Cloud alessandra.bilardi@corley.it corley.it
- 3. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Alessandra Bilardi Data & Automation Specialist @ Corley Cloud alessandra.bilardi@corley.it corley.it
- 4. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Alessandra Bilardi Data & Automation Specialist @ Corley Cloud alessandra.bilardi@corley.it corley.it
- 5. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 SUMMARY DevOps methods MLOps methods LLMOps methods Take away
- 6. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 DevOps methods & actors
- 7. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 CI / CD & actors
- 8. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 DevOps methods & actors
- 9. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 DevOps methods & actors
- 10. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 DevOps ● code ● monitoring ○ metrics ○ logs Resources versioned or saved with a timestamp
- 11. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & actors
- 12. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 CI / CD & actors
- 13. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML system
- 14. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML system
- 15. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML system
- 16. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML system
- 17. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 18. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 19. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Forecasting
- 20. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Forecasting
- 21. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Forecasting
- 22. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Forecasting
- 23. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Forecasting
- 24. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 25. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 26. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 27. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Sentiment analysis
- 28. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Sentiment analysis
- 29. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Sentiment analysis
- 30. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Sentiment analysis
- 31. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Sentiment analysis
- 32. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Sentiment analysis
- 33. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 34. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 35. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps ● code ○ processing ○ training ○ inference ○ evaluation ● model & baselines ● monitoring ○ metrics ○ logs ○ bias ■ training baseline vs new data ■ prediction baseline vs new pred Resources versioned or saved with a timestamp
- 36. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 37. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Face recognition
- 38. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Face recognition
- 39. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Face recognition
- 40. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & actors
- 41. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & actors
- 42. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & steps
- 43. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & steps
- 44. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & steps
- 45. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & steps
- 46. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & steps
- 47. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps ● code ○ processing ○ training ○ inference ○ evaluation ● model & baselines ● embeddings ● monitoring ○ metrics ○ logs ○ bias ■ training baseline vs new data ■ prediction baseline vs new pred Resources versioned or saved with a timestamp
- 48. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps methods & actors
- 49. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 CI / CD & actors
- 50. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 51. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 52. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 LLM
- 53. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 LLM
- 54. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 LLM
- 55. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Chat bot - preparation steps
- 56. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Chat bot - preparation steps
- 57. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Chat bot - production version 1.0
- 58. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Chat bot - production version 1.1
- 59. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Chat bot - production version 2.0
- 60. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & steps
- 61. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps methods & steps
- 62. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps methods & steps
- 63. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps methods & steps
- 64. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps methods & steps
- 65. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps methods & steps
- 66. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps ● code ○ processing ++ ○ [ training ] ++ ○ inference ++ ■ RAG ○ evaluation ● model & baselines ● embeddings ++ ● prompt ● monitoring ○ metrics ○ logs ○ bias & malicious behaviors ■ training baseline vs new data ■ prediction baseline vs new pred Resources versioned or saved with a timestamp
- 67. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Take away MLOps vs LLMOps Methods Resources MLOps LLMOps Computing small & CPU or GPU big & GPU Training often rarely Evaluation metrics Accuracy, AUC, .. BLEU, ROGUE, .. Embeddings small big Prompt ❌ ✅ Monitoring metrics, logs, bias also hacking
- 68. MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024 Thanks for listening!