Hopiu/llm
1
0
Fork 0
mirror of https://github.com/Hopiu/llm.git synced 2026-05-08 13:54:44 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Improved compatible models documentation, refs #106, #107

Browse source
This commit is contained in:
Simon Willison 2023-07-15 15:44:53 -07:00
parent e2072f7044
commit 723d349f4f
1 changed files with 10 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

10
docs/other-models.md
View file

@ -84,3 +84,13 @@ To add the `orca-mini-3b` model hosted by a local installation of [LocalAI](http
If the `api_base` is set, the existing configured `openai` API key will not be sent by default.
You can set `api_key_name` to the name of a key stored using the {ref}`api-keys` feature.
Having configured the model like this, run `llm models list` to check that it installed correctly. You can then run prompts against it like so:
```bash
llm -m orca-openai-compat 'What is the capital of France?'
```
And confirm they were logged correctly with:
```bash
llm logs -n 1
```