llm/docs/plugins/installing-plugins.md

71 lines
1.5 KiB
Markdown

(installing-plugins)=
# Installing plugins
Plugins must be installed in the same virtual environment as LLM itself.
You can find names of plugins to install in the [llm-plugins](https://github.com/simonw/llm-plugins) repository.
Use the `llm install` command (a thin wrapper around `pip install`) to install plugins in the correct environment:
```bash
llm install llm-gpt4all
```
Plugins can be uninstalled with `llm uninstall`:
```bash
llm uninstall llm-gpt4all -y
```
The `-y` flag skips asking for confirmation.
You can see additional models that have been added by plugins by running:
```bash
llm models list
```
Or add `--options` to include details of the options available for each model:
```bash
llm models list --options
```
To run a prompt against a newly installed model, pass its name as the `-m/--model` option:
```bash
llm -m ggml-vicuna-7b-1 'What is the capital of France?'
```
## Listing installed plugins
Run `llm plugins` to list installed plugins:
```bash
llm plugins
```
```json
[
{
"name": "llm-mpt30b",
"hooks": [
"register_commands",
"register_models"
],
"version": "0.1"
},
{
"name": "llm-palm",
"hooks": [
"register_commands",
"register_models"
],
"version": "0.1"
},
{
"name": "llm.default_plugins.openai_models",
"hooks": [
"register_commands",
"register_models"
]
},
{
"name": "llm-gpt4all",
"hooks": [
"register_models"
],
"version": "0.1"
}
]
```