Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow multiple models to be selected from the same provider #1296

Open
SeanBannister opened this issue Oct 15, 2024 · 3 comments
Open

Allow multiple models to be selected from the same provider #1296

SeanBannister opened this issue Oct 15, 2024 · 3 comments

Comments

@SeanBannister
Copy link

With OpenAI now providing o1-preview at quite an expensive price and it being much slower, I still want to use it sometimes but will usually use gpt-4o. It would be awesome if we could select multiple models from the same provider which would then be selectable in the left hand menu. This was I could easily switch between 4o and o1 without going into settings every time.

@wong2
Copy link
Collaborator

wong2 commented Oct 16, 2024

I think you can archieve this with the "Custom Chatbots" feature

@SeanBannister
Copy link
Author

Unfortunately this doesn't work because, o1 doesn't support streaming, you get the following error when trying to chat with the model:

{"error":{"message":"Unsupported value: 'stream' does not support true with this model. Only the default (false) value is supported.","type":"invalid_request_error","param":"stream","code":"unsupported_value"}}

Maybe there could be a checkbox in the custom chatbots to turn off streaming.

@wong2
Copy link
Collaborator

wong2 commented Oct 17, 2024

I think you can use o1 with the built-in OpenAI provider, and other GPT models with the custom chatbots.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants