From the course: AWS Certified AI Practitioner (AIF-C01) Cert Prep

Unlock this course with a free trial

Join today to access over 24,700 courses taught by industry experts.

Foundation model business objective criteria

Foundation model business objective criteria

- How do we determine if an AI model is delivering business value? Well, there are a number of objectives and considerations that we should take a look at to be able to do this. The first is just whether or not the result aligns with business objectives. Does it address specific goals? We can use performance metrics to find KPIs that can be used to measure whether or not business value is being delivered. We can solicit user feedback, qualitative insight from the end users and we can evaluate how well the model has integrated into the existing workflows without causing other issues and so how do we evaluate productivity? We have an example of a customer support AI chatbot. Well, some metrics we could use to help with this is the average response time and ticket resolution rate. We could even use sentiment analysis on the conversation as a sort of metric and the analysis for this would be to compare the the pre-AI model metrics with the post-AI model metrics to assess the impact on…

Contents