Allow to override endpoints by configuration #2711
Labels
area:configuration
Relates to configuration options
kind:enhancement
Indicates a new feature request, imrovement, or extension
Validations
Problem
I’m trying to use CodeLlama deployed on databricks but the endpoint is /invocations rather than /completions, using OpenAI-compatible provided.
Solution
It would be useful if we could override the completion endpoint by configuration.
The text was updated successfully, but these errors were encountered: