Hopiu/llm
1
0
Fork 0
mirror of https://github.com/Hopiu/llm.git synced 2026-04-27 00:14:46 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
702 commits 2 branches 0 tags 1.6 MiB
Commit graph

190 commits

Author SHA1 Message Date
Simon Willison
286cf9fcd9 attachments= keyword argument, tests pass again - refs #587 2024-10-28 15:41:34 -07:00
Andrew Wason
a466ddf3cd
Fix broken tests. Drop python 3.8. (#580) 
* Fix broken tests.  Drop python 3.8.
* Test on Python 3.13 too

---------

Co-authored-by: Simon Willison <swillison@gmail.com>
 2024-10-27 11:26:47 -07:00
Simon Willison
6deed8f976 get_model() improvement, get_default_model() / set_default_wodel() now documented 
Refs #553
 2024-08-18 17:37:31 -07:00
Simon Willison
a83421607a Switch default model to gpt-4o-mini (from gpt-3.5-turbo), refs #536 2024-07-18 11:57:19 -07:00
Simon Willison
964f4d9934 Fix for llm logs -q plus -m bug, closes #515 2024-06-16 14:35:38 -07:00
Simon Willison
fb63c92cd2 llm logs -r/--response option, closes #431 2024-03-04 13:29:07 -08:00
Simon Willison
8021e12aaa
Windows readline fix, plus run CI against macOS and Windows 
* Run CI on Windows and macOS as well as Ubuntu, refs #407
* Use pyreadline3 on win32
* Back to fail-fast since we have a bigger matrix now
* Mark some tests as xfail on windows
 2024-01-26 16:24:58 -08:00
Simon Willison
9119b03a07 Chmod 600 keys.json on creation, refs #351 2024-01-26 13:18:13 -08:00
Simon Willison
214fcaaf86
Upgrade to run against OpenAI >= 1.0 
* strategy: fail-fast: false - to help see all errors
* Apply latest Black

Refs #325
 2024-01-25 22:00:44 -08:00
Simon Willison
469644c2af
Test using test-llm-load-plugins.sh 
* Run test-llm-load-plugins.sh, closes #378
 2024-01-25 17:44:34 -08:00
Simon Willison
8b78ac6099 Fix for bug where embed did not use default model, closes #317 2023-10-31 21:19:59 -07:00
e. alvarez
839b4d7161
Fix issues: #274, #280 (#282) 
* Fix issue with reading directories in `iterate_files()` (#280)
* Add directory checking logic in `iterate_files()` (#274)
* Added tests for #282, #274, #280

---------

Co-authored-by: Simon Willison <swillison@gmail.com>
 2023-09-18 23:14:30 -07:00
Simon Willison
b4ec54ef19 NotImplementedError for system prompts with OpenAI completion models, refs #284 
Signed-off-by: Simon Willison <swillison@gmail.com>
 2023-09-18 22:51:22 -07:00
Simon Willison
f76b2120e4 Revert "Handle system prompts for completion models, refs #284" 
This reverts commit 4eed871cf1.

Decesion made in #288
 2023-09-18 22:44:38 -07:00
Simon Willison
4eed871cf1 Handle system prompts for completion models, refs #284 2023-09-18 22:36:38 -07:00
Simon Willison
fcff36c6bc completion: true to register completion models, refs #284 2023-09-18 22:17:26 -07:00
Simon Willison
4fea46113f logprobs support for OpenAI completion models, refs #284 2023-09-18 22:04:28 -07:00
Simon Willison
2b504279d9 Test for OpenAI chat streaming, closes #287 2023-09-18 21:27:36 -07:00
Simon Willison
4d18da4e11 Bump default gpt-3.5-turbo-instruct max tokens to 256, refs #284 2023-09-18 20:29:39 -07:00
Simon Willison
4d46ebaa32 OpenAI completion models including gpt-3.5-turbo-instruct, refs #284 2023-09-18 18:34:32 -07:00
Simon Willison
356fcb72f6 NumPy decoding docs, plus extra tests for llm.encode/decode 
!stable-docs

Refs https://discord.com/channels/823971286308356157/1128504153841336370/1151975583237034056
 2023-09-14 14:01:47 -07:00
Simon Willison
33dee4762e llm embed-multi --batch-size option, closes #273 2023-09-13 16:33:27 -07:00
Simon Willison
b9478e6a17 batch_size= argument to embed_multi(), refs #273 2023-09-13 16:24:04 -07:00
Simon Willison
6c43948325 llm.user_dir() creates directory if needed, closes #275 
Would have fixed this bug too:
- https://github.com/simonw/llm-sentence-transformers/issues/9
 2023-09-13 15:58:18 -07:00
Simon Willison
603da35e37 Fixed flaky order tests, refs #271 2023-09-12 11:37:36 -07:00
Simon Willison
9e529bb36a Wrap !multi in single quotes, for consistency with exit/quit 2023-09-12 10:45:02 -07:00
Simon Willison
f54f2c659d response.__str__ method, closes #268 2023-09-12 10:36:29 -07:00
Simon Willison
9c33d30843 llm chat !multi support, closes #267 2023-09-12 09:31:20 -07:00
Simon Willison
22a59f795e llm collections defaults to llm collections list, close #265 2023-09-11 23:08:11 -07:00
Simon Willison
591ad6f571 Revert "Reuse embeddings for hashed content, --store now works on second run - closes #224" 
This reverts commit 267e2ea999.

It's broken, see:

https://github.com/simonw/llm/issues/224#issuecomment-1715014393
 2023-09-11 22:56:52 -07:00
Simon Willison
267e2ea999 Reuse embeddings for hashed content, --store now works on second run - closes #224 2023-09-11 22:44:22 -07:00
Simon Willison
52cec1304b
Binary embeddings (#254) 
* Binary embeddings support, refs #253
* Write binary content to content_blob, with tests - refs #253
* supports_text and supports_binary embedding validation, refs #253
 2023-09-11 18:58:44 -07:00
Simon Willison
5ba34dbe36 llm embed-db is now llm collections, refs #229 2023-09-10 14:24:27 -07:00
Alexis Métaireau
df32d7685d
Updated error message for invalid or missing embedding model (#257) 
* Updated error message for missing embedding model

---------

Co-authored-by: Simon Willison <swillison@gmail.com>
 2023-09-10 11:56:29 -07:00
Simon Willison
2246e8f4fd Make tests robust against extra plugins, closes #258 2023-09-10 11:21:04 -07:00
Simon Willison
ae7f4f6de7 llm chat -o/--option - refs #244 2023-09-10 11:14:28 -07:00
Simon Willison
8de6783dcc llm chat test system prompt 2023-09-04 23:36:25 -07:00
Simon Willison
c14959571e llm chat test continue conversation 2023-09-04 23:36:25 -07:00
Simon Willison
5495112d9f Initial tests for llm chat, refs #231 2023-09-04 23:36:25 -07:00
Simon Willison
78a0e9bd44 llm --files --encoding option and latin-1 fallback, closes #225 2023-09-04 12:28:31 -07:00
Simon Willison
2e90a30c4f Add embedding model aliases to llm aliases, refs #192 2023-09-03 17:55:56 -07:00
Simon Willison
408297f1f5 Fixed test I broke in #217 2023-09-03 17:55:28 -07:00
Simon Willison
3bf781fba2 Duplicate content is only embedded once, closes #217 2023-09-03 17:39:11 -07:00
Simon Willison
0eda99e91c Default embedding model finishing touches, closes #222 2023-09-03 17:21:47 -07:00
Simon Willison
b9c19a5666 Tests for multiple --files pairs 2023-09-03 16:40:00 -07:00
Simon Willison
6f62b7d613 Tests for llm embed-multi --files, refs #215 2023-09-03 16:40:00 -07:00
Simon Willison
0da1ed7d98 --remove-default for llm embed-models default, refs #222 2023-09-03 16:40:00 -07:00
Simon Willison
c8c0f80441 --prefix for llm embed-multi, refs #215 2023-09-03 16:40:00 -07:00
Simon Willison
70a3d4bdc4 Test for llm embed-multi against SQLite, refs #215 2023-09-03 16:40:00 -07:00
Simon Willison
5e686fe8b3 Tests for CSV/TSV/JSON/NL, refs #215 2023-09-03 16:40:00 -07:00
Simon Willison
156bed7c65 Populate content_hash with embed_multi, refs #217 2023-09-03 14:43:29 -07:00
Simon Willison
213e0b0c75 embed-db delete-collection command and .delete() method, closes #219 2023-09-03 12:55:48 -07:00
Simon Willison
a5d6b580ba Store content_hash in embeddings table, refs #217 
Uses new migrations feature from https://github.com/simonw/sqlite-migrate/issues/9
 2023-09-03 10:50:51 -07:00
Simon Willison
26332045dd llm embed --metadata option, closes #209 2023-09-03 07:43:23 -07:00
Simon Willison
73a9043108 Store updated timestamp on embeddings, closes #211 2023-09-02 20:40:33 -07:00
Simon Willison
51488c579b Collection now defaults to in-memory DB, closes #213 2023-09-02 15:43:20 -07:00
Simon Willison
3d56d6cc24 Collection design tweaks + llm embed/similar now use it, closes #204 2023-09-02 08:30:56 -07:00
Simon Willison
6b042a264a Fixed -i and -i - modes for llm embed command 2023-09-01 20:24:58 -07:00
Simon Willison
3b2d5bf7f9 embed_multi and embed_multi_with_metadata, closes #202 2023-09-01 20:15:28 -07:00
Simon Willison
4be89facb5 Fixed and finished llm similar command, closes #190 2023-09-01 19:01:16 -07:00
Simon Willison
3ee92152e8 Error conditions for 'llm similar', refs #190 2023-09-01 18:31:59 -07:00
Simon Willison
de6d257dde collection.similar now returns List[Entry], closes #203 2023-09-01 18:06:56 -07:00
Simon Willison
d2f3d319c2 Test and docs for collection.embed(metadata=), refs #203 2023-09-01 17:57:54 -07:00
Simon Willison
4955a5fa6c Docs and test for store=True, refs #203 2023-09-01 17:52:43 -07:00
Simon Willison
ae1e7dadb4 Fixed tests for similar, refs #191 2023-09-01 16:28:11 -07:00
Simon Willison
0ec516559a Collection.similar methods, refs #191 2023-09-01 16:26:58 -07:00
Simon Willison
6f761702dc Initial Collection class plus test, refs #191 2023-09-01 13:04:05 -07:00
Simon Willison
817aff8bae Embeddings now happen in batches, closes #200 2023-08-31 22:27:06 -07:00
Simon Willison
8099384391 Add foreign key from embeddings to collections, refs #185 2023-08-31 22:16:25 -07:00
Simon Willison
b30f6894f7 Fixed bug if LLM directory does not exist, closes #193 2023-08-31 20:26:05 -07:00
Simon Willison
77cf56e54a
Initial CLI support and plugin hook for embeddings, refs #185 
* Embeddings plugin hook + OpenAI implementation
* llm.get_embedding_model(name) function
* llm embed command, for returning embeddings or saving them to SQLite
* Tests using an EmbedDemo embedding model
* llm embed-models list and emeb-models default commands
* llm embed-db path and llm embed-db collections commands
 2023-08-27 22:24:10 -07:00
Simon Willison
dff36f0edc Change of policy: keys.json over-rides environment variables, closes #158 2023-08-20 23:27:21 -07:00
Simon Willison
e959026051 llm keys command, closes #174 2023-08-20 23:11:47 -07:00
Simon Willison
c8e9565f47 Combine piped and argument prompts, closes #153 2023-08-20 22:57:29 -07:00
Simon Willison
091984cca2 Refactor to use llm.set_alias() / remove_alias(), closes #154 2023-08-19 22:11:19 -07:00
Simon Willison
c290b44d45 llm.remove_alias() function, refs #154 2023-08-19 22:06:51 -07:00
Simon Willison
2d73e6c8d1 Test set_alias(..., alias) too, refs #154 2023-08-19 22:02:58 -07:00
Simon Willison
8cdcf1e689 llm.set_alias() function, refs #154 2023-08-19 22:01:29 -07:00
Simon Willison
0cd9333054 llm aliases defaults to llm aliases list, refs #154 
Refs #167
 2023-08-19 21:48:20 -07:00
Simon Willison
36f8ffc2a1 Test for llm models --options, refs #169 2023-08-19 21:26:23 -07:00
Simon Willison
14a91efbad Fixes for Pydantic 1, including matrix test - refs #169 
Also refs #147
 2023-08-19 20:59:30 -07:00
Simon Willison
0eeb8393ca llm models and llm templates default to list, closes #167 2023-08-19 20:04:14 -07:00
Simon Willison
075d9af3b6 Test for migrations fix in #162 2023-08-19 13:17:47 -07:00
Simon Willison
79d09936cb Lose the indentation for log output, refs #160 2023-08-17 14:12:57 -07:00
Simon Willison
113df5dd87 llm logs now defaults to text output, use --json for JSON, use -c X for specific conversation 
Refs #160
 2023-08-17 13:57:18 -07:00
Simon Willison
458a59a8f4 Actually register aliases from aliases.json, closes #151 2023-08-12 09:15:17 -07:00
Simon Willison
3aab6cc2c4 Test for llm aliases remove invalid - refs #151 2023-08-12 09:06:38 -07:00
Simon Willison
53289e3767 llm aliases remove command, refs #151 2023-08-12 09:05:02 -07:00
Simon Willison
4a68aa408a llm aliases path command, refs #151 2023-08-12 09:01:51 -07:00
Simon Willison
8fc9cd1902 llm aliasess set command, refs #151 2023-08-12 09:01:12 -07:00
Simon Willison
b8f8869778 llm aliases list --json option, refs #151 2023-08-12 08:52:57 -07:00
Simon Willison
7207554719 Updated test for new alignment of aliases, refs #151 2023-08-11 23:18:46 -07:00
Simon Willison
a8059a24a9 Docs and tests for llm aliases list, refs #151 2023-08-11 23:00:20 -07:00
Pavel Král
838484b1f3
Set min/max constraints to float arguments 
* Add .idea/ to .gitignore
* Set min and max constraints to float parameters

Closes #115
 2023-07-26 10:59:09 -07:00
Simon Willison
cb41409e2b conversation_name should not have newlines, closes #110 2023-07-15 21:28:35 -07:00
Simon Willison
178af27d95 llm logs list -q/--query option, closes #109 2023-07-15 16:20:28 -07:00
Simon Willison
75e40e7077 Enable FTS indexes on responses prompt and response columns, refs #109 2023-07-15 16:03:35 -07:00
Simon Willison
ed8cd776a4 llm logs list -m model_id/alias option, closes #108 2023-07-15 15:55:13 -07:00
Simon Willison
e2072f7044 Ability to register additional OpenAI-compatible models 
Closes #107, closes #106
 2023-07-15 10:01:03 -07:00
Simon Willison
fa67b3fdaf --log option, closes #68 2023-07-11 20:18:16 -07:00