Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Need a clearer message on the GUI when the model failed to load because the computer can't handle the context size that is currently set #6427

Open
TiagoTiago opened this issue Oct 2, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@TiagoTiago
Copy link

Description

Hasn't happened too often so I keep having to rediscover that this was the issue; some models have a maximum context size that does not fit the hardware, and so when the GUI auto-fills the maximum context size with the default value the model fails to load. It would be good to have clear indication that the model itself fits, everything else is fine, but the context window is set to big for the current hardware.

@TiagoTiago TiagoTiago added the enhancement New feature or request label Oct 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant