This is an internal Upwork fork of FastChat.

Setup

Create a virtual env.

# Run this once after cloning.
python3 -m venv .venv
# Run this to activate the venv.
. .venv/bin/activate
# Run this to deactive the venv.
deactivate

Install

pip install -e ".[model_worker,webui]"

Run web UI

python3 -m fastchat.serve.gradio_web_server --controller-url= --model-list-mode=reload --register-api-endpoint-file=fastchat_api_endpoints.json

Note that to use OpenAI/Fireworks models the env vars OPENAI_API_KEY and FIREWORKS_API_KEY must be set.