Hopiu/llm
1
0
Fork 0
mirror of https://github.com/Hopiu/llm.git synced 2026-03-19 14:10:25 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
633 commits 2 branches 0 tags 1.6 MiB
Commit graph

61 commits

Author SHA1 Message Date
Simon Willison
21df241443 llm-claude-3 is now called llm-anthropic 
Refs https://github.com/simonw/llm-claude-3/issues/31

!stable-docs
 2025-02-01 22:08:19 -08:00
Simon Willison
e449fd4f46
Typo fix 
!stable-docs
 2025-01-22 22:17:07 -08:00
Ryan Patterson
59983740e6
Update directory.md (#666) 2025-01-18 14:52:51 -08:00
abrasumente
e1388b27fe
Add llm-deepseek plugin (#517) 2025-01-11 18:56:34 -08:00
Steven Weaver
2b6b00641c
Update tutorial-model-plugin.md (#685) 
pydantic.org -> pydantic.dev
 2025-01-11 12:05:05 -08:00
watany
1c61b5addd
doc(plugin): adding AmazonBedrock (#698) 2025-01-10 16:42:39 -08:00
Arjan Mossel
4f4f9bc07d
Add llm-venice to plugin directory (#699) 2025-01-10 16:41:21 -08:00
Simon Willison
cfb10f4afd
Log input tokens, output tokens and token details (#642) 
* Store input_tokens, output_tokens, token_details on Response, closes #610
* llm prompt -u/--usage option
* llm logs -u/--usage option
* Docs on tracking token usage in plugins
* OpenAI default plugin logs usage
 2024-11-19 20:21:59 -08:00
Simon Willison
cf172cc70a response.text_or_raise() workaround 
Closes https://github.com/simonw/llm/issues/632
 2024-11-14 15:08:41 -08:00
Simon Willison
ba75c674cb
llm.get_async_model(), llm.AsyncModel base class and OpenAI async models (#613) 
- https://github.com/simonw/llm/issues/507#issuecomment-2458639308

* register_model is now async aware

Refs https://github.com/simonw/llm/issues/507#issuecomment-2458658134

* Refactor Chat and AsyncChat to use _Shared base class

Refs https://github.com/simonw/llm/issues/507#issuecomment-2458692338

* fixed function name

* Fix for infinite loop

* Applied Black

* Ran cog

* Applied Black

* Add Response.from_row() classmethod back again

It does not matter that this is a blocking call, since it is a classmethod

* Made mypy happy with llm/models.py

* mypy fixes for openai_models.py

I am unhappy with this, had to duplicate some code.

* First test for AsyncModel

* Still have not quite got this working

* Fix for not loading plugins during tests, refs #626

* audio/wav not audio/wave, refs #603

* Black and mypy and ruff all happy

* Refactor to avoid generics

* Removed obsolete response() method

* Support text = await async_mock_model.prompt("hello")

* Initial docs for llm.get_async_model() and await model.prompt()

Refs #507

* Initial async model plugin creation docs

* duration_ms ANY to pass test

* llm models --async option

Refs https://github.com/simonw/llm/pull/613#issuecomment-2474724406

* Removed obsolete TypeVars

* Expanded register_models() docs for async

* await model.prompt() now returns AsyncResponse

Refs https://github.com/simonw/llm/pull/613#issuecomment-2475157822

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2024-11-13 17:51:00 -08:00
Hiepler
5a984d0c87
docs: add llm-grok (#629) 
Adds`llm-grok` xAI API (https://github.com/Hiepler/llm-grok) to the plugin directory.

!stable-docs
 2024-11-13 17:21:04 -08:00
Simon Willison
7520671176 audio/wav not audio/wave, refs #603 2024-11-12 21:43:07 -08:00
Simon Willison
0cc4072bcd Support attachments without prompts, closes #611 2024-11-05 21:27:18 -08:00
Simon Willison
fe1e09706f
llm-lambda-labs 
!stable-docs
 2024-11-04 10:26:02 -08:00
Simon Willison
1126393ba1 Docs for writing models that accept attachments, refs #587 2024-10-28 15:41:34 -07:00
Simon Willison
7e6031e382
llm-gguf, llm-jq 
!stable-docs
 2024-10-26 22:44:06 -07:00
Kian-Meng Ang
50520c7c1c
Fix typos (#567) 
Found via `codespell -H -L wit,thre`

!stable-docs
 2024-09-08 08:44:43 -07:00
Simon Willison
ab1cc4fd1f Release 0.14 
Refs #404, #431, #470, #490, #491
 2024-05-13 13:26:48 -07:00
Fabian Labat
6cdc29c8d6
Update directory.md (#486) 
* Update directory.md

Added support for Bedrock Llama 3
 2024-05-13 13:01:33 -07:00
Simon Willison
3cc588f247 List llm-llamafile in plugins directory, closes #470 2024-05-13 12:55:22 -07:00
Simon Willison
04915e95f8
llm-groq 
!stable-docs
 2024-04-21 20:33:23 -07:00
Simon Willison
2a9b6113f5
llm-perplexity 
Refs https://github.com/hex/llm-perplexity/issues/2

!stable-docs
 2024-04-21 16:18:37 -07:00
Simon Willison
99a2836638
llm-fireworks 
Refs https://github.com/simonw/llm-fireworks/issues/1

!stable-docs
 2024-04-18 17:20:09 -07:00
Simon Willison
9ad9ac68dc
llm-reka in plugin directory 
!stable-docs
 2024-04-17 19:38:41 -07:00
Simon Willison
12e027d3e4
llm-command-r 
!stable-docs

Refs https://github.com/simonw/llm-command-r/issues/1
 2024-04-04 07:41:03 -07:00
Simon Willison
008efae86a
llm-cmd 
!stable-docs

Refs https://github.com/simonw/llm-cmd/issues/1
 2024-03-26 08:58:48 -07:00
Simon Willison
5852aa1574
llm-claude-3 
!stable-docs
 2024-03-04 10:48:57 -08:00
Simon Willison
de6af1ca2f
llm-embed-onnx in plugin directory 
!stable-docs

Refs https://github.com/simonw/llm-embed-onnx/issues/1
 2024-01-28 14:27:13 -08:00
Simon Willison
5293b9dd72
Added llm-together 
!stable-docs
 2024-01-27 10:40:40 -08:00
Fabian Labat
81225ab94b
llm-bedrock-meta plugin 
!stable-docs
 2024-01-26 14:13:20 -08:00
Max Davitt
bf082cbf11 Fix typo and broken link for Gemini in directory 
Refs #389

!stable-docs
 2024-01-25 14:00:09 -08:00
Till Hohenberger
7ec958c080
Add ollama to plugin directory (#395) 
* Add ollama to plugin directory

!stable-docs
 2024-01-25 13:57:40 -08:00
Simon Willison
b0a4473149
llm-mistral and llm-gemini 
!stable-docs
 2023-12-14 21:36:45 -08:00
Simon Willison
df7d24835b
Link to article about generators 
!stable-docs
 2023-11-12 08:13:59 -08:00
Will Sorenson
ebc19f1848
Add Bedrock Anthropic plugin (#307) 2023-10-31 21:22:04 -07:00
Simon Willison
e75de8373a
llm-python in plugin directory 
Refs https://github.com/simonw/llm-python/issues/1

!stable-docs
 2023-10-26 22:42:04 -07:00
Simon Willison
9266eb5eab
llm-embed-jina in plugins directory 
!stable-docs

Refs:
- https://github.com/simonw/llm-embed-jina/issues/1
 2023-10-25 18:29:30 -07:00
Simon Willison
9e5421e7a8 Update llm-gpt4all examples for latest release 
!stable-docs

Refs https://github.com/simonw/llm-gpt4all/issues/16
 2023-10-24 12:39:04 -07:00
Simon Willison
d70c0dba43
llm-clip 
!stable-docs
 2023-09-13 16:43:46 -07:00
Simon Willison
59255fb71c
llm-cohere in plugin directory 
!stable-docs
 2023-09-13 16:40:34 -07:00
Simon Willison
6c43948325 llm.user_dir() creates directory if needed, closes #275 
Would have fixed this bug too:
- https://github.com/simonw/llm-sentence-transformers/issues/9
 2023-09-13 15:58:18 -07:00
Simon Willison
b84f6f9ffd Docs for LLM_LOAD_PLUGINS, closes #256 2023-09-10 14:12:37 -07:00
Simon Willison
206e691844
llm-cluster 
!stable-docs

Refs https://github.com/simonw/llm-cluster/issues/1
 2023-09-04 09:36:56 -07:00
Simon Willison
2cc9b6087f Embedding models in plugin directory, refs #207 2023-09-03 19:39:10 -07:00
Simon Willison
0cb9a2ea68 Suggest orca-mini-7b because ggml-vicuna-7b-1 is no longer available, closes #195 2023-08-31 20:30:46 -07:00
Simon Willison
b5260b4eb0
llm-anyscale-endpoints 
!stable-docs
 2023-08-23 13:46:48 -07:00
Simon Willison
7744cf9b79
llm-openrouter in plugin directory 
Closes #168

!stable-docs
 2023-08-21 00:05:35 -07:00
Simon Willison
6aa2990892 This is directory.md now, refs #173 2023-08-20 22:24:21 -07:00
Simon Willison
6155f12c9c Move plugin directory into LLM repo, refs #173 2023-08-20 22:17:16 -07:00
Simon Willison
0eeb8393ca llm models and llm templates default to list, closes #167 2023-08-19 20:04:14 -07:00