summaryrefslogtreecommitdiff
path: root/README.md
diff options
context:
space:
mode:
authorGrail Finder <wohilas@gmail.com>2025-01-22 20:17:49 +0300
committerGrail Finder <wohilas@gmail.com>2025-01-22 20:17:49 +0300
commit75f51c1a19632ea093e1aad6a91cc7f4a349658c (patch)
tree71a944e90d9ee06f91d257aa7573081a0419e1a1 /README.md
parentc41ff09b2f62b8c715ec9beb2fdac987b25892d9 (diff)
Feat: llamacpp /completion attempt
Diffstat (limited to 'README.md')
-rw-r--r--README.md2
1 files changed, 2 insertions, 0 deletions
diff --git a/README.md b/README.md
index cb593fa..7de7558 100644
--- a/README.md
+++ b/README.md
@@ -40,6 +40,7 @@
- consider adding use /completion of llamacpp, since openai endpoint clearly has template|format issues;
- change temp, min-p and other params from tui;
- DRY;
+- keybind to switch between openai and llamacpp endpoints;
### FIX:
- bot responding (or hanging) blocks everything; +
@@ -63,3 +64,4 @@
- number of sentences in a batch should depend on number of words there. +
- F1 can load any chat, by loading chat of other agent it does not switch agents, if that chat is continued, it will rewrite agent in db; (either allow only chats from current agent OR switch agent on chat loading); +
- after chat is deleted: load undeleted chat; +
+- name split for llamacpp completion. user msg should end with 'bot_name:';