Hopiu/llm
1
0
Fork 0
mirror of https://github.com/Hopiu/llm.git synced 2026-04-30 09:54:46 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
847 commits 2 branches 0 tags 1.6 MiB
Commit graph

486 commits

Author SHA1 Message Date
Simon Willison
1d75792f9b More uv/uvx tips, closes #702 
Refs #690
 2025-01-11 10:06:32 -08:00
Ariel Marcus
d964d02e90
Add installation docs with uv (#690) 2025-01-11 09:57:10 -08:00
watany
1c61b5addd
doc(plugin): adding AmazonBedrock (#698) 2025-01-10 16:42:39 -08:00
Arjan Mossel
4f4f9bc07d
Add llm-venice to plugin directory (#699) 2025-01-10 16:41:21 -08:00
Simon Willison
6baf1f7d83 o1 
Closes #676
 2025-01-10 15:57:06 -08:00
Csaba Henk
88a8cfd9e4
llm logs -x/--extract option (#693) 
* llm logs -x/--extract option
* Update docs/help.md for llm logs -x
* Added test for llm logs -x/--extract, refs #693
* llm logs -xr behaves same as llm logs -x
* -x/--extract in llm logging docs

---------

Co-authored-by: Simon Willison <swillison@gmail.com>
 2025-01-10 15:53:04 -08:00
Simon Willison
b452effa09 llm models -q/--query option, closes #700 2025-01-09 11:37:33 -08:00
Simon Willison
000e984def --extract support for templates, closes #681 2024-12-19 07:16:48 -08:00
Simon Willison
67d4a99645 llm prompt -x/--extract option, closes #681 2024-12-19 06:40:05 -08:00
Simon Willison
6305b86026 gpt-4o-mini-audio-preview, closes #677 2024-12-17 20:28:57 -08:00
Simon Willison
8898584ba6 New OpenAI audio models, closes #677 2024-12-17 11:14:42 -08:00
Simon Willison
b8e8052229 Release 0.19.1 
Refs #667
 2024-12-05 13:47:28 -08:00
Simon Willison
e78fea17df Fragment hash on 0.19 release 
!stable-docs
 2024-12-01 16:09:55 -08:00
Simon Willison
c018104083 Release 0.19 
Refs #495, #610, #640, #641, #644, #653
 2024-12-01 15:58:27 -08:00
Simon Willison
f9af563df5 response.on_done() mechanism, closes #653 2024-12-01 15:47:23 -08:00
Simon Willison
335b3e635a Release 0.19a2 
Refs #640
 2024-11-20 20:12:43 -08:00
Simon Willison
c52cfee881 llm.get_models() and llm.get_async_models(), closes #640 2024-11-20 20:09:06 -08:00
Simon Willison
845322e970 Release 0.19a1 
Refs #644
 2024-11-19 21:28:01 -08:00
Simon Willison
02852fe1a5 Release 0.19a0 
Refs #610, #641
 2024-11-19 20:23:54 -08:00
Simon Willison
cfb10f4afd
Log input tokens, output tokens and token details (#642) 
* Store input_tokens, output_tokens, token_details on Response, closes #610
* llm prompt -u/--usage option
* llm logs -u/--usage option
* Docs on tracking token usage in plugins
* OpenAI default plugin logs usage
 2024-11-19 20:21:59 -08:00
Simon Willison
a6d62b7ec9 Release 0.18 
Refs #507, #600, #603, #608, #611, #612, #614
 2024-11-17 12:31:48 -08:00
Simon Willison
73823012ca Release 0.18a1 
Refs #632
 2024-11-14 15:10:39 -08:00
Simon Willison
cf172cc70a response.text_or_raise() workaround 
Closes https://github.com/simonw/llm/issues/632
 2024-11-14 15:08:41 -08:00
Simon Willison
041730d8b2 Release 0.18a0 
Refs #507, #599, #600, #603, #608, #611, #612, #613, #614, #615, #616, #621, #622, #623, #626, #629
 2024-11-13 17:55:28 -08:00
Simon Willison
ba75c674cb
llm.get_async_model(), llm.AsyncModel base class and OpenAI async models (#613) 
- https://github.com/simonw/llm/issues/507#issuecomment-2458639308

* register_model is now async aware

Refs https://github.com/simonw/llm/issues/507#issuecomment-2458658134

* Refactor Chat and AsyncChat to use _Shared base class

Refs https://github.com/simonw/llm/issues/507#issuecomment-2458692338

* fixed function name

* Fix for infinite loop

* Applied Black

* Ran cog

* Applied Black

* Add Response.from_row() classmethod back again

It does not matter that this is a blocking call, since it is a classmethod

* Made mypy happy with llm/models.py

* mypy fixes for openai_models.py

I am unhappy with this, had to duplicate some code.

* First test for AsyncModel

* Still have not quite got this working

* Fix for not loading plugins during tests, refs #626

* audio/wav not audio/wave, refs #603

* Black and mypy and ruff all happy

* Refactor to avoid generics

* Removed obsolete response() method

* Support text = await async_mock_model.prompt("hello")

* Initial docs for llm.get_async_model() and await model.prompt()

Refs #507

* Initial async model plugin creation docs

* duration_ms ANY to pass test

* llm models --async option

Refs https://github.com/simonw/llm/pull/613#issuecomment-2474724406

* Removed obsolete TypeVars

* Expanded register_models() docs for async

* await model.prompt() now returns AsyncResponse

Refs https://github.com/simonw/llm/pull/613#issuecomment-2475157822

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2024-11-13 17:51:00 -08:00
Hiepler
5a984d0c87
docs: add llm-grok (#629) 
Adds`llm-grok` xAI API (https://github.com/Hiepler/llm-grok) to the plugin directory.

!stable-docs
 2024-11-13 17:21:04 -08:00
Simon Willison
7520671176 audio/wav not audio/wave, refs #603 2024-11-12 21:43:07 -08:00
Travis Northcutt
c0cb1697bc
Update default model information (#622) 
The default model is now 4o-mini; this change updates the usage page of the docs to reflect that
 2024-11-12 19:06:16 -08:00
Simon Willison
dff53a9cae Better --help for llm keys get, refs #623 2024-11-11 09:53:24 -08:00
Simon Willison
561784df6e llm keys get command, refs #623 2024-11-11 09:47:13 -08:00
Simon Willison
febbc04fb6
Run cog -r in PRs, use that to update logging.md with new tables (#616) 
* Create cog.yml
* Document attachments and prompt_attachments table schemas

Closes #615

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2024-11-06 06:56:19 -08:00
Simon Willison
98d2c19876 Promote alternative model providers in llm --help 2024-11-06 06:38:53 -08:00
Simon Willison
245e025270 Ran cog, refs #612 2024-11-05 23:45:17 -08:00
Chris Mungall
3b2e5263a3
Allow passing of can_stream in openai_models.py (#600) 
* Allow passing of can_stream in openai_models.py

Fixes #599 

* Only set can_stream: false if it is false

Refs https://github.com/simonw/llm/pull/600#issuecomment-2458825866

* Docs for can_stream: false

---------

Co-authored-by: Simon Willison <swillison@gmail.com>
 2024-11-05 23:04:13 -08:00
Simon Willison
12df1a3b2a Show attachment types in llm models --options, closes #612 2024-11-05 22:49:26 -08:00
Simon Willison
0cc4072bcd Support attachments without prompts, closes #611 2024-11-05 21:27:18 -08:00
Simon Willison
41cb5c3387 Ran cog, refs #608 2024-11-05 21:13:36 -08:00
Simon Willison
fe1e09706f
llm-lambda-labs 
!stable-docs
 2024-11-04 10:26:02 -08:00
Simon Willison
a44ba49c21 Release 0.17 
Refs #587, #590, #591
 2024-10-28 19:36:12 -07:00
Simon Willison
ba1ccb3a4a Release 0.17a0 
Refs #587, #590
 2024-10-28 15:46:52 -07:00
Simon Willison
1f822d820b Update docs with cog 2024-10-28 15:41:34 -07:00
Simon Willison
f0ed54abf1 Docs for CLI attachments, refs #587 2024-10-28 15:41:34 -07:00
Simon Willison
570a3eccae Python attachment documentation, plus fixed a mimetype detection bug 
Refs #587
 2024-10-28 15:41:34 -07:00
Simon Willison
1126393ba1 Docs for writing models that accept attachments, refs #587 2024-10-28 15:41:34 -07:00
Simon Willison
7e6031e382
llm-gguf, llm-jq 
!stable-docs
 2024-10-26 22:44:06 -07:00
Simon Willison
d654c95212 Release notes for 0.16 2024-09-12 16:20:12 -07:00
Simon Willison
bfcfd2c91b
o1-preview and o1-mini, refs #570 (#573) 2024-09-12 16:08:04 -07:00
Kian-Meng Ang
50520c7c1c
Fix typos (#567) 
Found via `codespell -H -L wit,thre`

!stable-docs
 2024-09-08 08:44:43 -07:00
Simon Willison
7d6ece2a31 Fix for broken markdown on openai-models page 
Refs #558 !stable-docs
 2024-08-25 18:03:46 -07:00
Simon Willison
6deed8f976 get_model() improvement, get_default_model() / set_default_wodel() now documented 
Refs #553
 2024-08-18 17:37:31 -07:00
Simon Willison
d075336c69 Release 0.15 
Refs #515, #525, #536, #537
 2024-07-18 12:31:14 -07:00
Simon Willison
562fefb374 Use 3-small in docs instead of ada-002 
Spotted while working on #537
 2024-07-18 12:23:49 -07:00
Simon Willison
fcba89d73b Update docs to reflect new gpt-4o-mini default, refs #536 2024-07-18 12:16:03 -07:00
Simon Donohue
50454c1957
Update outdated reference to gpt-4-turbo (#525) 
Looks like this alias was overlooked in 8171c9a. This commit makes it
match with the usage of gpt-4o in the associated example.
 2024-07-18 12:10:40 -07:00
Simon Willison
2881576dd0 Re-ran cog, refs #536 2024-07-18 12:00:35 -07:00
Simon Willison
96db13f537
Link to new video 
!stable-docs
 2024-06-17 10:18:24 -07:00
Simon Willison
68df9721de
github repo static badge 
!stable-docs
 2024-05-13 18:41:07 -07:00
Simon Willison
45245413bd
GitHub stars badge 
!stable-docs
 2024-05-13 15:09:56 -07:00
Simon Willison
9a3236db61 gpt-4-turbo model ID, closes #493 2024-05-13 13:37:23 -07:00
Simon Willison
ab1cc4fd1f Release 0.14 
Refs #404, #431, #470, #490, #491
 2024-05-13 13:26:48 -07:00
Fabian Labat
6cdc29c8d6
Update directory.md (#486) 
* Update directory.md

Added support for Bedrock Llama 3
 2024-05-13 13:01:33 -07:00
Simon Willison
3cc588f247 List llm-llamafile in plugins directory, closes #470 2024-05-13 12:55:22 -07:00
Simon Willison
8171c9a6bf Update help for GPT-4o, closes #490 2024-05-13 12:53:31 -07:00
Simon Willison
73bbbec372 gpt-4o model, refs #490 2024-05-13 12:49:45 -07:00
Simon Willison
04915e95f8
llm-groq 
!stable-docs
 2024-04-21 20:33:23 -07:00
Simon Willison
2a9b6113f5
llm-perplexity 
Refs https://github.com/hex/llm-perplexity/issues/2

!stable-docs
 2024-04-21 16:18:37 -07:00
Simon Willison
99a2836638
llm-fireworks 
Refs https://github.com/simonw/llm-fireworks/issues/1

!stable-docs
 2024-04-18 17:20:09 -07:00
Simon Willison
9ad9ac68dc
llm-reka in plugin directory 
!stable-docs
 2024-04-17 19:38:41 -07:00
Simon Willison
12e027d3e4
llm-command-r 
!stable-docs

Refs https://github.com/simonw/llm-command-r/issues/1
 2024-04-04 07:41:03 -07:00
Simon Willison
008efae86a
llm-cmd 
!stable-docs

Refs https://github.com/simonw/llm-cmd/issues/1
 2024-03-26 08:58:48 -07:00
Simon Willison
fb63c92cd2 llm logs -r/--response option, closes #431 2024-03-04 13:29:07 -08:00
Simon Willison
5852aa1574
llm-claude-3 
!stable-docs
 2024-03-04 10:48:57 -08:00
Simon Willison
de6af1ca2f
llm-embed-onnx in plugin directory 
!stable-docs

Refs https://github.com/simonw/llm-embed-onnx/issues/1
 2024-01-28 14:27:13 -08:00
Simon Willison
5293b9dd72
Added llm-together 
!stable-docs
 2024-01-27 10:40:40 -08:00
Simon Willison
7e89b88565 Fixed missing link in changelog for 0.4 
!stable-docs
 2024-01-26 21:54:37 -08:00
Simon Willison
8021e12aaa
Windows readline fix, plus run CI against macOS and Windows 
* Run CI on Windows and macOS as well as Ubuntu, refs #407
* Use pyreadline3 on win32
* Back to fail-fast since we have a bigger matrix now
* Mark some tests as xfail on windows
 2024-01-26 16:24:58 -08:00
Simon Willison
e32d9b35e3
Link to annotated release notes 
!stable-docs
 2024-01-26 15:11:56 -08:00
Simon Willison
8e0aff6090 Release 0.13 
Refs #325, #351, #373, #376, #394, #396, #397, #404

Closes #402
 2024-01-26 14:32:23 -08:00
Fabian Labat
81225ab94b
llm-bedrock-meta plugin 
!stable-docs
 2024-01-26 14:13:20 -08:00
Simon Willison
2b92756046 Homebrew PyTorch warning, closes #397 2024-01-26 13:59:27 -08:00
Simon Willison
46763326ed Homebrew installation, refs #315, #397 
This reverts commit abcb457b20.
 2024-01-26 13:50:21 -08:00
Simon Willison
4f7489876d Syntax highlighting for docs/contributing.md 2024-01-26 12:05:58 -08:00
Simon Willison
5d0d7a911b Documentation update for 404 2024-01-26 10:42:38 -08:00
Simon Willison
214fcaaf86
Upgrade to run against OpenAI >= 1.0 
* strategy: fail-fast: false - to help see all errors
* Apply latest Black

Refs #325
 2024-01-25 22:00:44 -08:00
Simon Willison
c09a3411d3 Documentation section about OpenAI models 
Closes #398, closes #396, closes #394
 2024-01-25 16:21:41 -08:00
Simon Willison
c4de730157 OpenAI API key URL has changed 2024-01-25 16:02:48 -08:00
Simon Willison
5bed6f13af gpt-4-1106-preview, gpt-4-0125-preview, gpt-4-turbo-preview models - refs #396 2024-01-25 15:13:55 -08:00
Max Davitt
bf082cbf11 Fix typo and broken link for Gemini in directory 
Refs #389

!stable-docs
 2024-01-25 14:00:09 -08:00
Till Hohenberger
7ec958c080
Add ollama to plugin directory (#395) 
* Add ollama to plugin directory

!stable-docs
 2024-01-25 13:57:40 -08:00
Simon Willison
044689351d Support new OpenAI embeddings models, refs #394 2024-01-25 13:10:41 -08:00
Simon Willison
53f80dd531 -o json_object 1 option for OpenAI Chat models, refs #373 2024-01-25 12:51:14 -08:00
Simon Willison
17b91e0c9c Document llm chat -c 
!stable-docs
 2024-01-17 13:59:06 -08:00
Simon Willison
95597cc8f5
Link to new blog entry 
!stable-docs
 2023-12-18 10:28:52 -08:00
Simon Willison
b0a4473149
llm-mistral and llm-gemini 
!stable-docs
 2023-12-14 21:36:45 -08:00
Simon Willison
df7d24835b
Link to article about generators 
!stable-docs
 2023-11-12 08:13:59 -08:00
Simon Willison
b2a12727f1
Add GPT 4 turbo model and -o seed 1 option (#329) 
Closes #323
Closes #324
 2023-11-06 13:32:04 -08:00
Simon Willison
10c6cc2a8e Release 0.11.2 
Refs #327
 2023-11-06 12:06:50 -08:00
Simon Willison
ff34fb2570 Release notes for 0.11.1 
Refs #317, https://github.com/simonw/llm-gpt4all/issues/16
 2023-10-31 21:29:59 -07:00
Will Sorenson
ebc19f1848
Add Bedrock Anthropic plugin (#307) 2023-10-31 21:22:04 -07:00
Simon Willison
abcb457b20 Remove homebrew suggestion for the moment, refs #315 
!stable-docs
 2023-10-27 21:36:38 -07:00
Simon Willison
8e84c00771
Link to blog post about building Jina embeddings plugin 2023-10-27 07:40:33 -07:00
Simon Willison
e75de8373a
llm-python in plugin directory 
Refs https://github.com/simonw/llm-python/issues/1

!stable-docs
 2023-10-26 22:42:04 -07:00
Simon Willison
9266eb5eab
llm-embed-jina in plugins directory 
!stable-docs

Refs:
- https://github.com/simonw/llm-embed-jina/issues/1
 2023-10-25 18:29:30 -07:00
dependabot[bot]
9167852696
Bump the python-packages group with 1 update (#279) 
Bumps the python-packages group with 1 update: [sphinx](https://github.com/sphinx-doc/sphinx).

- [Release notes](https://github.com/sphinx-doc/sphinx/releases)
- [Changelog](https://github.com/sphinx-doc/sphinx/blob/master/CHANGES.rst)
- [Commits](https://github.com/sphinx-doc/sphinx/compare/v7.2.5...v7.2.6)

---
updated-dependencies:
- dependency-name: sphinx
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: python-packages
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-10-24 14:07:18 -07:00
Simon Willison
9e5421e7a8 Update llm-gpt4all examples for latest release 
!stable-docs

Refs https://github.com/simonw/llm-gpt4all/issues/16
 2023-10-24 12:39:04 -07:00
Simon Willison
bf229945fe Release 0.11 
Refs #273, #274, #275, #280, #284, #286
 2023-09-18 23:35:04 -07:00
Simon Willison
bb99186cc1 Docs for completion prompts, closes #284 2023-09-18 22:56:16 -07:00
Simon Willison
fcff36c6bc completion: true to register completion models, refs #284 2023-09-18 22:17:26 -07:00
Simon Willison
4fea46113f logprobs support for OpenAI completion models, refs #284 2023-09-18 22:04:28 -07:00
Simon Willison
ae14ce4add LLM_OPENAI_SHOW_RESPONSES=1 debug trick, closes #286 2023-09-18 21:13:42 -07:00
Simon Willison
356fcb72f6 NumPy decoding docs, plus extra tests for llm.encode/decode 
!stable-docs

Refs https://discord.com/channels/823971286308356157/1128504153841336370/1151975583237034056
 2023-09-14 14:01:47 -07:00
Simon Willison
d70c0dba43
llm-clip 
!stable-docs
 2023-09-13 16:43:46 -07:00
Simon Willison
59255fb71c
llm-cohere in plugin directory 
!stable-docs
 2023-09-13 16:40:34 -07:00
Simon Willison
33dee4762e llm embed-multi --batch-size option, closes #273 2023-09-13 16:33:27 -07:00
Simon Willison
b9478e6a17 batch_size= argument to embed_multi(), refs #273 2023-09-13 16:24:04 -07:00
Simon Willison
6c43948325 llm.user_dir() creates directory if needed, closes #275 
Would have fixed this bug too:
- https://github.com/simonw/llm-sentence-transformers/issues/9
 2023-09-13 15:58:18 -07:00
Simon Willison
ed89490492 Link to new blog post 
!stable-docs
 2023-09-12 14:16:23 -07:00
Simon Willison
a44d025233 Fixed markdown glitch on changelog 
!stable-docs
 2023-09-12 12:17:52 -07:00
Simon Willison
e83d205778 Release 0.10 
Refs #225, #229, #231, #254, #256, #259
 2023-09-12 12:11:25 -07:00
Simon Willison
e6dac1a1bd Documentation for building binary embedding plugins, refs #264 2023-09-12 11:32:12 -07:00
Simon Willison
4952a8d119 llm similar --binary, closes #269 2023-09-12 11:23:31 -07:00
Simon Willison
506de80f69 Renamed binary.md to storage.md and documented --binary embeddings, refs #264 2023-09-12 11:15:17 -07:00
Simon Willison
eea7b4e0fb Various documentation copy improvements, refs #264 2023-09-12 11:04:45 -07:00
Simon Willison
946f072cc0 llm install -U llm for Homebrew 2023-09-12 10:47:13 -07:00
Simon Willison
9e529bb36a Wrap !multi in single quotes, for consistency with exit/quit 2023-09-12 10:45:02 -07:00
Simon Willison
37f85b3a1f Document model options in Python API, closes #187 2023-09-12 10:36:47 -07:00
Simon Willison
f54f2c659d response.__str__ method, closes #268 2023-09-12 10:36:29 -07:00
Simon Willison
9c33d30843 llm chat !multi support, closes #267 2023-09-12 09:31:20 -07:00
Simon Willison
22a59f795e llm collections defaults to llm collections list, close #265 2023-09-11 23:08:11 -07:00
Simon Willison
90ab024604 Release 0.10a1 
Refs #229, #244, #247, #248, #254, #256, #259, #263
 2023-09-11 22:57:54 -07:00
Simon Willison
52cec1304b
Binary embeddings (#254) 
* Binary embeddings support, refs #253
* Write binary content to content_blob, with tests - refs #253
* supports_text and supports_binary embedding validation, refs #253
 2023-09-11 18:58:44 -07:00
dependabot[bot]
4fab55f253
Bump furo (#262) 
Bumps the python-packages group with 1 update: [furo](https://github.com/pradyunsg/furo).

- [Release notes](https://github.com/pradyunsg/furo/releases)
- [Changelog](https://github.com/pradyunsg/furo/blob/main/docs/changelog.md)
- [Commits](https://github.com/pradyunsg/furo/compare/2023.08.19...2023.09.10)

---
updated-dependencies:
- dependency-name: furo
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-packages
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-11 18:18:05 -07:00
mhalle
f07b291a78
change type of cli "embed -c" to be STR not FILE (#263) 
* change type of cli "embed -c" to be STR not FILE

The type of the "content" argument was erroneously set to be FILE with a "type=click.Path(...)" argument, which content is a string.

---------

Co-authored-by: Simon Willison <swillison@gmail.com>
 2023-09-11 18:17:34 -07:00
Simon Willison
5ba34dbe36 llm embed-db is now llm collections, refs #229 2023-09-10 14:24:27 -07:00
Simon Willison
6012f31e36 llm plugins --all option, closes #259 2023-09-10 14:18:16 -07:00
Simon Willison
b84f6f9ffd Docs for LLM_LOAD_PLUGINS, closes #256 2023-09-10 14:12:37 -07:00
Simon Willison
79b3cd8b72 Documented llm chat -o, closes #244 2023-09-10 13:46:55 -07:00
Simon Willison
ab05023b30 Ran cog, refs #248 2023-09-10 11:49:32 -07:00
Simon Willison
2fe12d5458 Ran cog, refs #244 2023-09-10 11:16:44 -07:00
Simon Willison
4f1b59b67b Tiny change to force a docs update 
!stable-docs

Refs #249
 2023-09-08 17:59:27 -07:00
Simon Willison
d0f435af53 Fixed bug in llm embed-multi documentation, closes #249 2023-09-08 17:58:41 -07:00
Simon Willison
b2fc0a11cf
Reference IDs 
!stable-docs
 2023-09-05 14:22:33 -07:00
Simon Willison
a66d47e106
Update Symbex section 2023-09-05 14:21:24 -07:00
Simon Willison
3164fde0fc
Typo 2023-09-05 00:21:30 -07:00
Simon Willison
3533e7027d Release 0.10a0 
Refs #225, #231
 2023-09-04 23:40:39 -07:00
Simon Willison
0699bb5e27 Docs for llm chat, refs #231 2023-09-04 23:36:25 -07:00
Simon Willison
969a5d3364 Initial prototype of llm chat, refs #231 2023-09-04 23:36:25 -07:00
Simon Willison
45b380c3f1 Fix broken internal references in help.md 2023-09-04 17:08:30 -07:00
Simon Willison
a74f63f421
Link to blog post 
!stable-docs
 2023-09-04 15:28:48 -07:00
Simon Willison
ba2c9e60f1 Promote my new blog entry about LLM embeddings 
!stable-docs
 2023-09-04 13:42:01 -07:00
Simon Willison
78a0e9bd44 llm --files --encoding option and latin-1 fallback, closes #225 2023-09-04 12:28:31 -07:00
Simon Willison
206e691844
llm-cluster 
!stable-docs

Refs https://github.com/simonw/llm-cluster/issues/1
 2023-09-04 09:36:56 -07:00
Simon Willison
62dd006099
Bold collection 
!stable-docs
 2023-09-04 08:30:45 -07:00
Simon Willison
a44e23876e
Fix broken example in docs (#223) 2023-09-03 20:53:51 -07:00
Simon Willison
2cc9b6087f Embedding models in plugin directory, refs #207 2023-09-03 19:39:10 -07:00
Simon Willison
5efb300c42 Release 0.9 
Refs #192, #209, #211, #213, #215, #217, #218, #219, #222

Closes #205
 2023-09-03 19:35:14 -07:00
Simon Willison
e6e1da321d Backfilled missing release notes from 0.8.1 2023-09-03 19:12:30 -07:00
Simon Willison
f842fbea49 Mention brute-force approach, link to vector indexing issue 
Refs #216. Closes #214
 2023-09-03 19:10:42 -07:00
Simon Willison
94f0a1a337 Promote embeddings in README/index, closes #210 2023-09-03 19:07:05 -07:00
Simon Willison
ee61cb0e22 Documentation for aliases for embedding models, closes #192 2023-09-03 18:00:14 -07:00
Simon Willison
2e90a30c4f Add embedding model aliases to llm aliases, refs #192 2023-09-03 17:55:56 -07:00
Simon Willison
3bf781fba2 Duplicate content is only embedded once, closes #217 2023-09-03 17:39:11 -07:00
Simon Willison
0eda99e91c Default embedding model finishing touches, closes #222 2023-09-03 17:21:47 -07:00
Simon Willison
8ce7046d13 Documentation for llm embed-multi, refs #215 2023-09-03 16:40:00 -07:00
Simon Willison
0da1ed7d98 --remove-default for llm embed-models default, refs #222 2023-09-03 16:40:00 -07:00
Simon Willison
c8c0f80441 --prefix for llm embed-multi, refs #215 2023-09-03 16:40:00 -07:00
Simon Willison
2440eb4f48 Help tweak and ran cog 2023-09-03 16:40:00 -07:00
Simon Willison
213e0b0c75 embed-db delete-collection command and .delete() method, closes #219 2023-09-03 12:55:48 -07:00
Simon Willison
06d35c890a Homebrew badge, closes #218 2023-09-03 11:50:18 -07:00
Simon Willison
a5d6b580ba Store content_hash in embeddings table, refs #217 
Uses new migrations feature from https://github.com/simonw/sqlite-migrate/issues/9
 2023-09-03 10:50:51 -07:00
Simon Willison
26332045dd llm embed --metadata option, closes #209 2023-09-03 07:43:23 -07:00
Simon Willison
b7e6c1675b Show SQL schema for embeddings in docs 2023-09-02 20:48:00 -07:00
Simon Willison
51488c579b Collection now defaults to in-memory DB, closes #213 2023-09-02 15:43:20 -07:00
Simon Willison
8bdaca1f31
orca-mini-7b in index.md 
Refs #195
 2023-09-02 11:47:06 -07:00
Simon Willison
e49c816e18 Drop llm.EmbeddingModel.embedding_size property, closes #208 2023-09-02 08:45:17 -07:00
Simon Willison
3d56d6cc24 Collection design tweaks + llm embed/similar now use it, closes #204 2023-09-02 08:30:56 -07:00
Simon Willison
6b042a264a Fixed -i and -i - modes for llm embed command 2023-09-01 20:24:58 -07:00
Simon Willison
3b2d5bf7f9 embed_multi and embed_multi_with_metadata, closes #202 2023-09-01 20:15:28 -07:00
Simon Willison
4be89facb5 Fixed and finished llm similar command, closes #190 2023-09-01 19:01:16 -07:00
Simon Willison
de6d257dde collection.similar now returns List[Entry], closes #203 2023-09-01 18:06:56 -07:00
Simon Willison
d2f3d319c2 Test and docs for collection.embed(metadata=), refs #203 2023-09-01 17:57:54 -07:00
Simon Willison
4955a5fa6c Docs and test for store=True, refs #203 2023-09-01 17:52:43 -07:00
Simon Willison
212cd617f3 Initial Python embeddings API docs, refs #191 2023-09-01 17:25:45 -07:00
Simon Willison
7a4429f100 Fix mypy errors 
Refs https://github.com/simonw/llm/issues/191#issuecomment-1703266224
 2023-09-01 13:14:59 -07:00
Simon Willison
c25e7c4713 Ran cog, refs #190 2023-08-31 23:13:20 -07:00
Simon Willison
817aff8bae Embeddings now happen in batches, closes #200 2023-08-31 22:27:06 -07:00
Simon Willison
02f671219e Improvements to embedding docs, refs #185 2023-08-31 21:55:39 -07:00
dependabot[bot]
d6cd3a0137
Bump sphinx and furo (#199) 
Bumps the python-packages group with 2 updates: [sphinx](https://github.com/sphinx-doc/sphinx) and [furo](https://github.com/pradyunsg/furo).


Updates `sphinx` from 7.2.2 to 7.2.5
- [Release notes](https://github.com/sphinx-doc/sphinx/releases)
- [Changelog](https://github.com/sphinx-doc/sphinx/blob/master/CHANGES)
- [Commits](https://github.com/sphinx-doc/sphinx/compare/v7.2.2...v7.2.5)

Updates `furo` from 2023.8.17 to 2023.8.19
- [Release notes](https://github.com/pradyunsg/furo/releases)
- [Changelog](https://github.com/pradyunsg/furo/blob/main/docs/changelog.md)
- [Commits](https://github.com/pradyunsg/furo/compare/2023.08.17...2023.08.19)

---
updated-dependencies:
- dependency-name: sphinx
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: python-packages
- dependency-name: furo
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: python-packages
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-31 20:36:03 -07:00
Chris Mungall
439f7951c3
Fix link to ttok repo (#198) 
Thanks, @cmungall
 2023-08-31 20:35:39 -07:00
Simon Willison
0cb9a2ea68 Suggest orca-mini-7b because ggml-vicuna-7b-1 is no longer available, closes #195 2023-08-31 20:30:46 -07:00
Simon Willison
5a9269a2ce
Typo 2023-08-31 16:58:02 -07:00
Simon Willison
77cf56e54a
Initial CLI support and plugin hook for embeddings, refs #185 
* Embeddings plugin hook + OpenAI implementation
* llm.get_embedding_model(name) function
* llm embed command, for returning embeddings or saving them to SQLite
* Tests using an EmbedDemo embedding model
* llm embed-models list and emeb-models default commands
* llm embed-db path and llm embed-db collections commands
 2023-08-27 22:24:10 -07:00
Simon Willison
b5260b4eb0
llm-anyscale-endpoints 
!stable-docs
 2023-08-23 13:46:48 -07:00
Simon Willison
7744cf9b79
llm-openrouter in plugin directory 
Closes #168

!stable-docs
 2023-08-21 00:05:35 -07:00
Simon Willison
ebe2e08a1f Release 0.8 
Refs #111, #147, #153, #154, #155, #158, #160, #167, #173, #174
 2023-08-20 23:53:09 -07:00
Simon Willison
dff36f0edc Change of policy: keys.json over-rides environment variables, closes #158 2023-08-20 23:27:21 -07:00
Simon Willison
e959026051 llm keys command, closes #174 2023-08-20 23:11:47 -07:00
Simon Willison
b92c940e30 Usage documentation no longer assumes OpenAI 2023-08-20 23:01:52 -07:00
Simon Willison
c8e9565f47 Combine piped and argument prompts, closes #153 2023-08-20 22:57:29 -07:00
Simon Willison
1212cc9221 Related tools documentation, closes #111 2023-08-20 22:34:29 -07:00