Simon Willison
b9478e6a17
batch_size= argument to embed_multi(), refs #273
2023-09-13 16:24:04 -07:00
Simon Willison
52cec1304b
Binary embeddings ( #254 )
...
* Binary embeddings support, refs #253
* Write binary content to content_blob, with tests - refs #253
* supports_text and supports_binary embedding validation, refs #253
2023-09-11 18:58:44 -07:00
Simon Willison
408297f1f5
Fixed test I broke in #217
2023-09-03 17:55:28 -07:00
Simon Willison
156bed7c65
Populate content_hash with embed_multi, refs #217
2023-09-03 14:43:29 -07:00
Simon Willison
213e0b0c75
embed-db delete-collection command and .delete() method, closes #219
2023-09-03 12:55:48 -07:00
Simon Willison
a5d6b580ba
Store content_hash in embeddings table, refs #217
...
Uses new migrations feature from https://github.com/simonw/sqlite-migrate/issues/9
2023-09-03 10:50:51 -07:00
Simon Willison
73a9043108
Store updated timestamp on embeddings, closes #211
2023-09-02 20:40:33 -07:00
Simon Willison
51488c579b
Collection now defaults to in-memory DB, closes #213
2023-09-02 15:43:20 -07:00
Simon Willison
3d56d6cc24
Collection design tweaks + llm embed/similar now use it, closes #204
2023-09-02 08:30:56 -07:00
Simon Willison
3b2d5bf7f9
embed_multi and embed_multi_with_metadata, closes #202
2023-09-01 20:15:28 -07:00
Simon Willison
de6d257dde
collection.similar now returns List[Entry], closes #203
2023-09-01 18:06:56 -07:00
Simon Willison
d2f3d319c2
Test and docs for collection.embed(metadata=), refs #203
2023-09-01 17:57:54 -07:00
Simon Willison
4955a5fa6c
Docs and test for store=True, refs #203
2023-09-01 17:52:43 -07:00
Simon Willison
ae1e7dadb4
Fixed tests for similar, refs #191
2023-09-01 16:28:11 -07:00
Simon Willison
0ec516559a
Collection.similar methods, refs #191
2023-09-01 16:26:58 -07:00
Simon Willison
6f761702dc
Initial Collection class plus test, refs #191
2023-09-01 13:04:05 -07:00
Simon Willison
817aff8bae
Embeddings now happen in batches, closes #200
2023-08-31 22:27:06 -07:00
Simon Willison
77cf56e54a
Initial CLI support and plugin hook for embeddings, refs #185
...
* Embeddings plugin hook + OpenAI implementation
* llm.get_embedding_model(name) function
* llm embed command, for returning embeddings or saving them to SQLite
* Tests using an EmbedDemo embedding model
* llm embed-models list and emeb-models default commands
* llm embed-db path and llm embed-db collections commands
2023-08-27 22:24:10 -07:00
