Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Unable to generate chat title when CUSTOM_MODELS removed gpt-3.5-turbo #3621

Open
1 of 3 tasks
Cow258 opened this issue Dec 24, 2023 · 2 comments
Open
1 of 3 tasks

Comments

@Cow258
Copy link

Cow258 commented Dec 24, 2023

Describe the bug

When CUSTOM_MODELS removed gpt-3.5-turbo,
Chat title will never be generated.

To Reproduce

Steps to reproduce the behavior:

  1. Set env CUSTOM_MODELS=-gpt-3.5-turbo
  2. Deploy
  3. Create new chat
  4. Ask something
  5. GPT will response successfully
  6. but chat title will never be generated

Expected behavior

Even if gpt-3.5-turbo disabled, the chat title should always be generated.

Screenshots

image
POST - /api/openai/v1/chat/completions
HTTP Status: 403

{
  "error": true,
  "message": "you are not allowed to use gpt-3.5-turbo model"
}

image
image

Deployment

  • Docker
  • Vercel
  • Server

Desktop (please complete the following information):

  • OS: Any
  • Browser: Any
  • Version: Any

Smartphone (please complete the following information):

  • Device: Any
  • OS: Any
  • Browser: Any
  • Version: Any

Additional Logs
Add any logs about the problem here.

@H0llyW00dzZ
Copy link
Contributor

been known this issue since a few month ago
it's because of this code

function getSummarizeModel(currentModel: string) {
  // if it is using gpt-* models, force to use 3.5 to summarize
  return currentModel.startsWith("gpt") ? SUMMARIZE_MODEL : currentModel;
}

location: chat.ts

on my fork, working fine now without that bug

@H0llyW00dzZ
Copy link
Contributor

H0llyW00dzZ commented Dec 24, 2023

this better now
I've been pull req before (a few month ago but yiidaa won't merge)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants