summaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorGrail Finder <wohilas@gmail.com>2025-12-13 16:57:37 +0300
committerGrail Finder <wohilas@gmail.com>2025-12-13 16:57:37 +0300
commit3a514e0d785e4f127e4f2dcc7dedf433d000f37f (patch)
tree6e24751f42736d126806217a9c65583cdfe1aecb
parent10718a9c136185b49994077f2046ad2b5918ef13 (diff)
Chore: comment about envvar
-rw-r--r--tutorial_rp.md20
1 files changed, 20 insertions, 0 deletions
diff --git a/tutorial_rp.md b/tutorial_rp.md
index 7391e51..6958e25 100644
--- a/tutorial_rp.md
+++ b/tutorial_rp.md
@@ -42,3 +42,23 @@ then press `x` to close the table.
#### choosing LLM provider and model
+supported backends: llama.cpp, openrouter and deepseek.
+for openrouter and deepseek you will need a token.
+set it in config.toml or set envvar
+```
+sed -i "/OpenRouterToken/s/=.*/= \"{YOUR_OPENROUTER_TOKEN}\"/" config.toml
+sed -i "/DeepSeekToken/s/=.*/= \"{YOUR_DEEPSEEK_TOKEN}\"/" config.toml
+# or set envvar
+export OPENROUTER_API_KEY={YOUR_OPENROUTER_TOKEN}
+export DEEPSEEK_API_KEY={YOUR_DEEPSEEK_TOKEN}
+```
+
+in case you're running llama.cpp here is an example of starting llama.cpp
+```
+./build/bin/llama-server -c 16384 -ngl 99 --models-dir ./models --models-max 1 --models-preset ./models/config.ini
+```
+
+<b>after changing config.toml or envvar you need to restart the program.</b>
+
+#### sending messages
+messages are send by pressing `Esc` button