Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Classifier-free guidance #506

Open
abb128 opened this issue Jul 19, 2023 · 1 comment
Open

Classifier-free guidance #506

abb128 opened this issue Jul 19, 2023 · 1 comment
Labels
enhancement New feature or request quality Quality of model output

Comments

@abb128
Copy link

abb128 commented Jul 19, 2023

Classifier-free guidance was implemented in llama.cpp in ggerganov/llama.cpp#2135, but it doesn't look like there's a way to use it with these bindings. It seems like a useful feature, so it'd be nice to have this
@abetlen
Copy link
Owner

abetlen commented Jul 20, 2023

@abb128 totally, the low-level api is implemented for this but not the high-level api, I'll add it to the v0.2 roadmap

@gjmulder gjmulder added enhancement New feature or request quality Quality of model output labels Jul 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request quality Quality of model output
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@abetlen @gjmulder @abb128