Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

common : add HF arg helpers #6234

Merged
merged 2 commits into from
Mar 22, 2024
Merged

common : add HF arg helpers #6234

merged 2 commits into from
Mar 22, 2024

Conversation

ggerganov
Copy link
Owner

@ggerganov ggerganov commented Mar 22, 2024

ref #4735 #5501 #6085 #6098

Sample usage:

./bin/main \
  --hf-repo TinyLlama/TinyLlama-1.1B-Chat-v0.2-GGUF \
  --hf-file ggml-model-q4_0.gguf \
  -m tinyllama-1.1-v0.2-q4_0.gguf \
  -p "I believe the meaning of life is" -n 32
./bin/main \
  --hf-repo TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF \
  -m tinyllama-1.1b-chat-v1.0.Q4_0.gguf \
  -p "I believe the meaning of life is" -n 32

Downloads https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v0.2-GGUF/resolve/main/ggml-model-q4_0.gguf and saves it to tinyllama-1.1-v0.2-q4_0.gguf

Requires build with LLAMA_CURL

Comment on lines 1424 to 1429
printf(" -mu MODEL_URL, --model-url MODEL_URL\n");
printf(" model download url (default: %s)\n", params.model_url.c_str());
printf(" -hfr REPO, --hf-repo REPO\n");
printf(" Hugging Face model repository (default: %s)\n", params.hf_repo.c_str());
printf(" -hff FILE, --hf-file FILE\n");
printf(" Hugging Face model file (default: %s)\n", params.hf_file.c_str());
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The default probably does not need to be printed here, since it will always be an empty string, and I do not expect that we will ever change that.

@ggerganov ggerganov merged commit 80bd33b into master Mar 22, 2024
16 of 17 checks passed
ggerganov added a commit that referenced this pull request Mar 22, 2024
hodlen pushed a commit to hodlen/llama.cpp that referenced this pull request Apr 1, 2024
* common : add HF arg helpers

* common : remove defaults
hodlen pushed a commit to hodlen/llama.cpp that referenced this pull request Apr 1, 2024
hodlen pushed a commit to hodlen/llama.cpp that referenced this pull request Apr 3, 2024
* common : add HF arg helpers

* common : remove defaults
hodlen pushed a commit to hodlen/llama.cpp that referenced this pull request Apr 3, 2024
tybalex pushed a commit to rubra-ai/tools.cpp that referenced this pull request Apr 17, 2024
* common : add HF arg helpers

* common : remove defaults
tybalex pushed a commit to rubra-ai/tools.cpp that referenced this pull request Apr 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants