From 723d349f4f9a91af2c627c86b5122fc510cb37d0 Mon Sep 17 00:00:00 2001 From: Simon Willison Date: Sat, 15 Jul 2023 15:44:53 -0700 Subject: [PATCH] Improved compatible models documentation, refs #106, #107 --- docs/other-models.md | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/docs/other-models.md b/docs/other-models.md index 53c9604..3257195 100644 --- a/docs/other-models.md +++ b/docs/other-models.md @@ -84,3 +84,13 @@ To add the `orca-mini-3b` model hosted by a local installation of [LocalAI](http If the `api_base` is set, the existing configured `openai` API key will not be sent by default. You can set `api_key_name` to the name of a key stored using the {ref}`api-keys` feature. + +Having configured the model like this, run `llm models list` to check that it installed correctly. You can then run prompts against it like so: + +```bash +llm -m orca-openai-compat 'What is the capital of France?' +``` +And confirm they were logged correctly with: +```bash +llm logs -n 1 +```