diff options
| author | Grail Finder <wohilas@gmail.com> | 2025-12-13 16:57:37 +0300 |
|---|---|---|
| committer | Grail Finder <wohilas@gmail.com> | 2025-12-13 16:57:37 +0300 |
| commit | 3a514e0d785e4f127e4f2dcc7dedf433d000f37f (patch) | |
| tree | 6e24751f42736d126806217a9c65583cdfe1aecb /tutorial_rp.md | |
| parent | 10718a9c136185b49994077f2046ad2b5918ef13 (diff) | |
Chore: comment about envvar
Diffstat (limited to 'tutorial_rp.md')
| -rw-r--r-- | tutorial_rp.md | 20 |
1 files changed, 20 insertions, 0 deletions
diff --git a/tutorial_rp.md b/tutorial_rp.md index 7391e51..6958e25 100644 --- a/tutorial_rp.md +++ b/tutorial_rp.md @@ -42,3 +42,23 @@ then press `x` to close the table. #### choosing LLM provider and model +supported backends: llama.cpp, openrouter and deepseek. +for openrouter and deepseek you will need a token. +set it in config.toml or set envvar +``` +sed -i "/OpenRouterToken/s/=.*/= \"{YOUR_OPENROUTER_TOKEN}\"/" config.toml +sed -i "/DeepSeekToken/s/=.*/= \"{YOUR_DEEPSEEK_TOKEN}\"/" config.toml +# or set envvar +export OPENROUTER_API_KEY={YOUR_OPENROUTER_TOKEN} +export DEEPSEEK_API_KEY={YOUR_DEEPSEEK_TOKEN} +``` + +in case you're running llama.cpp here is an example of starting llama.cpp +``` +./build/bin/llama-server -c 16384 -ngl 99 --models-dir ./models --models-max 1 --models-preset ./models/config.ini +``` + +<b>after changing config.toml or envvar you need to restart the program.</b> + +#### sending messages +messages are send by pressing `Esc` button |
