llm/docs/plugins/installing-plugins.md

(installing-plugins)=

Installing plugins

Plugins must be installed in the same virtual environment as LLM itself.

You can find names of plugins to install in the {ref}plugin directory <plugin-directory>

Use the llm install command (a thin wrapper around pip install) to install plugins in the correct environment:

llm install llm-gpt4all

Plugins can be uninstalled with llm uninstall:

llm uninstall llm-gpt4all -y

The -y flag skips asking for confirmation.

You can see additional models that have been added by plugins by running:

llm models

Or add --options to include details of the options available for each model:

llm models --options

To run a prompt against a newly installed model, pass its name as the -m/--model option:

llm -m orca-mini-7b 'What is the capital of France?'

Listing installed plugins

Run llm plugins to list installed plugins:

llm plugins

[
  {
    "name": "llm-mpt30b",
    "hooks": [
      "register_commands",
      "register_models"
    ],
    "version": "0.1"
  },
  {
    "name": "llm-palm",
    "hooks": [
      "register_commands",
      "register_models"
    ],
    "version": "0.1"
  },
  {
    "name": "llm.default_plugins.openai_models",
    "hooks": [
      "register_commands",
      "register_models"
    ]
  },
  {
    "name": "llm-gpt4all",
    "hooks": [
      "register_models"
    ],
    "version": "0.1"
  }
]