Skip to content

Handle temporary model issues #259713

@kieferrm

Description

@kieferrm

GH will change 503 json return

{
  "error" : {
     "message" : "some message",
     "code" : "some_error_code"
  }
}

to support model_overloaded and model_degraded. We'll need to handle these new error code appropriately.

We're also discussing that the list of models we fetch should support the same annotations that we then should render in the model picker. If so, we should re-fetch the model list when we receive a 503 with aforementioned error codes and update the model picker.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions