Simon Willison
0eda99e91c
Default embedding model finishing touches, closes #222
2023-09-03 17:21:47 -07:00
Simon Willison
b9c19a5666
Tests for multiple --files pairs
2023-09-03 16:40:00 -07:00
Simon Willison
6f62b7d613
Tests for llm embed-multi --files, refs #215
2023-09-03 16:40:00 -07:00
Simon Willison
0da1ed7d98
--remove-default for llm embed-models default, refs #222
2023-09-03 16:40:00 -07:00
Simon Willison
c8c0f80441
--prefix for llm embed-multi, refs #215
2023-09-03 16:40:00 -07:00
Simon Willison
70a3d4bdc4
Test for llm embed-multi against SQLite, refs #215
2023-09-03 16:40:00 -07:00
Simon Willison
5e686fe8b3
Tests for CSV/TSV/JSON/NL, refs #215
2023-09-03 16:40:00 -07:00
Simon Willison
156bed7c65
Populate content_hash with embed_multi, refs #217
2023-09-03 14:43:29 -07:00
Simon Willison
213e0b0c75
embed-db delete-collection command and .delete() method, closes #219
2023-09-03 12:55:48 -07:00
Simon Willison
a5d6b580ba
Store content_hash in embeddings table, refs #217
...
Uses new migrations feature from https://github.com/simonw/sqlite-migrate/issues/9
2023-09-03 10:50:51 -07:00
Simon Willison
26332045dd
llm embed --metadata option, closes #209
2023-09-03 07:43:23 -07:00
Simon Willison
73a9043108
Store updated timestamp on embeddings, closes #211
2023-09-02 20:40:33 -07:00
Simon Willison
51488c579b
Collection now defaults to in-memory DB, closes #213
2023-09-02 15:43:20 -07:00
Simon Willison
3d56d6cc24
Collection design tweaks + llm embed/similar now use it, closes #204
2023-09-02 08:30:56 -07:00
Simon Willison
6b042a264a
Fixed -i and -i - modes for llm embed command
2023-09-01 20:24:58 -07:00
Simon Willison
3b2d5bf7f9
embed_multi and embed_multi_with_metadata, closes #202
2023-09-01 20:15:28 -07:00
Simon Willison
4be89facb5
Fixed and finished llm similar command, closes #190
2023-09-01 19:01:16 -07:00
Simon Willison
3ee92152e8
Error conditions for 'llm similar', refs #190
2023-09-01 18:31:59 -07:00
Simon Willison
de6d257dde
collection.similar now returns List[Entry], closes #203
2023-09-01 18:06:56 -07:00
Simon Willison
d2f3d319c2
Test and docs for collection.embed(metadata=), refs #203
2023-09-01 17:57:54 -07:00
Simon Willison
4955a5fa6c
Docs and test for store=True, refs #203
2023-09-01 17:52:43 -07:00
Simon Willison
ae1e7dadb4
Fixed tests for similar, refs #191
2023-09-01 16:28:11 -07:00
Simon Willison
0ec516559a
Collection.similar methods, refs #191
2023-09-01 16:26:58 -07:00
Simon Willison
6f761702dc
Initial Collection class plus test, refs #191
2023-09-01 13:04:05 -07:00
Simon Willison
817aff8bae
Embeddings now happen in batches, closes #200
2023-08-31 22:27:06 -07:00
Simon Willison
8099384391
Add foreign key from embeddings to collections, refs #185
2023-08-31 22:16:25 -07:00
Simon Willison
b30f6894f7
Fixed bug if LLM directory does not exist, closes #193
2023-08-31 20:26:05 -07:00
Simon Willison
77cf56e54a
Initial CLI support and plugin hook for embeddings, refs #185
...
* Embeddings plugin hook + OpenAI implementation
* llm.get_embedding_model(name) function
* llm embed command, for returning embeddings or saving them to SQLite
* Tests using an EmbedDemo embedding model
* llm embed-models list and emeb-models default commands
* llm embed-db path and llm embed-db collections commands
2023-08-27 22:24:10 -07:00
Simon Willison
dff36f0edc
Change of policy: keys.json over-rides environment variables, closes #158
2023-08-20 23:27:21 -07:00
Simon Willison
e959026051
llm keys command, closes #174
2023-08-20 23:11:47 -07:00
Simon Willison
c8e9565f47
Combine piped and argument prompts, closes #153
2023-08-20 22:57:29 -07:00
Simon Willison
091984cca2
Refactor to use llm.set_alias() / remove_alias(), closes #154
2023-08-19 22:11:19 -07:00
Simon Willison
c290b44d45
llm.remove_alias() function, refs #154
2023-08-19 22:06:51 -07:00
Simon Willison
2d73e6c8d1
Test set_alias(..., alias) too, refs #154
2023-08-19 22:02:58 -07:00
Simon Willison
8cdcf1e689
llm.set_alias() function, refs #154
2023-08-19 22:01:29 -07:00
Simon Willison
0cd9333054
llm aliases defaults to llm aliases list, refs #154
...
Refs #167
2023-08-19 21:48:20 -07:00
Simon Willison
36f8ffc2a1
Test for llm models --options, refs #169
2023-08-19 21:26:23 -07:00
Simon Willison
14a91efbad
Fixes for Pydantic 1, including matrix test - refs #169
...
Also refs #147
2023-08-19 20:59:30 -07:00
Simon Willison
0eeb8393ca
llm models and llm templates default to list, closes #167
2023-08-19 20:04:14 -07:00
Simon Willison
075d9af3b6
Test for migrations fix in #162
2023-08-19 13:17:47 -07:00
Simon Willison
79d09936cb
Lose the indentation for log output, refs #160
2023-08-17 14:12:57 -07:00
Simon Willison
113df5dd87
llm logs now defaults to text output, use --json for JSON, use -c X for specific conversation
...
Refs #160
2023-08-17 13:57:18 -07:00
Simon Willison
458a59a8f4
Actually register aliases from aliases.json, closes #151
2023-08-12 09:15:17 -07:00
Simon Willison
3aab6cc2c4
Test for llm aliases remove invalid - refs #151
2023-08-12 09:06:38 -07:00
Simon Willison
53289e3767
llm aliases remove command, refs #151
2023-08-12 09:05:02 -07:00
Simon Willison
4a68aa408a
llm aliases path command, refs #151
2023-08-12 09:01:51 -07:00
Simon Willison
8fc9cd1902
llm aliasess set command, refs #151
2023-08-12 09:01:12 -07:00
Simon Willison
b8f8869778
llm aliases list --json option, refs #151
2023-08-12 08:52:57 -07:00
Simon Willison
7207554719
Updated test for new alignment of aliases, refs #151
2023-08-11 23:18:46 -07:00
Simon Willison
a8059a24a9
Docs and tests for llm aliases list, refs #151
2023-08-11 23:00:20 -07:00