mirror of
https://github.com/Hopiu/llm.git
synced 2026-03-17 21:20:24 +00:00
71 lines
1.5 KiB
Markdown
71 lines
1.5 KiB
Markdown
(installing-plugins)=
|
|
# Installing plugins
|
|
|
|
Plugins must be installed in the same virtual environment as LLM itself.
|
|
|
|
You can find names of plugins to install in the [llm-plugins](https://github.com/simonw/llm-plugins) repository.
|
|
|
|
Use the `llm install` command (a thin wrapper around `pip install`) to install plugins in the correct environment:
|
|
```bash
|
|
llm install llm-gpt4all
|
|
```
|
|
Plugins can be uninstalled with `llm uninstall`:
|
|
```bash
|
|
llm uninstall llm-gpt4all -y
|
|
```
|
|
The `-y` flag skips asking for confirmation.
|
|
|
|
You can see additional models that have been added by plugins by running:
|
|
```bash
|
|
llm models list
|
|
```
|
|
Or add `--options` to include details of the options available for each model:
|
|
```bash
|
|
llm models list --options
|
|
```
|
|
To run a prompt against a newly installed model, pass its name as the `-m/--model` option:
|
|
```bash
|
|
llm -m ggml-vicuna-7b-1 'What is the capital of France?'
|
|
```
|
|
|
|
## Listing installed plugins
|
|
|
|
Run `llm plugins` to list installed plugins:
|
|
|
|
```bash
|
|
llm plugins
|
|
```
|
|
```json
|
|
[
|
|
{
|
|
"name": "llm-mpt30b",
|
|
"hooks": [
|
|
"register_commands",
|
|
"register_models"
|
|
],
|
|
"version": "0.1"
|
|
},
|
|
{
|
|
"name": "llm-palm",
|
|
"hooks": [
|
|
"register_commands",
|
|
"register_models"
|
|
],
|
|
"version": "0.1"
|
|
},
|
|
{
|
|
"name": "llm.default_plugins.openai_models",
|
|
"hooks": [
|
|
"register_commands",
|
|
"register_models"
|
|
]
|
|
},
|
|
{
|
|
"name": "llm-gpt4all",
|
|
"hooks": [
|
|
"register_models"
|
|
],
|
|
"version": "0.1"
|
|
}
|
|
]
|
|
```
|