Commit graph

352 commits

Author SHA1 Message Date
Simon Willison
94f0a1a337 Promote embeddings in README/index, closes #210 2023-09-03 19:07:05 -07:00
Simon Willison
c9f7299149 Release 0.9a1
Refs #192, #209, #211, #213, #215, #217, #218, #219, #222
2023-09-03 18:18:13 -07:00
Simon Willison
a54743f228 Fix to get embedding set_alias to work
Refs:
- https://github.com/simonw/llm-sentence-transformers/issues/4
- https://github.com/simonw/llm/issues/192
2023-09-03 18:15:45 -07:00
Simon Willison
ee61cb0e22 Documentation for aliases for embedding models, closes #192 2023-09-03 18:00:14 -07:00
Simon Willison
2e90a30c4f Add embedding model aliases to llm aliases, refs #192 2023-09-03 17:55:56 -07:00
Simon Willison
408297f1f5 Fixed test I broke in #217 2023-09-03 17:55:28 -07:00
Simon Willison
3bf781fba2 Duplicate content is only embedded once, closes #217 2023-09-03 17:39:11 -07:00
Simon Willison
0eda99e91c Default embedding model finishing touches, closes #222 2023-09-03 17:21:47 -07:00
Simon Willison
8ce7046d13 Documentation for llm embed-multi, refs #215 2023-09-03 16:40:00 -07:00
Simon Willison
b9c19a5666 Tests for multiple --files pairs 2023-09-03 16:40:00 -07:00
Simon Willison
6f62b7d613 Tests for llm embed-multi --files, refs #215 2023-09-03 16:40:00 -07:00
Simon Willison
0da1ed7d98 --remove-default for llm embed-models default, refs #222 2023-09-03 16:40:00 -07:00
Simon Willison
c8c0f80441 --prefix for llm embed-multi, refs #215 2023-09-03 16:40:00 -07:00
Simon Willison
70a3d4bdc4 Test for llm embed-multi against SQLite, refs #215 2023-09-03 16:40:00 -07:00
Simon Willison
5e686fe8b3 Tests for CSV/TSV/JSON/NL, refs #215 2023-09-03 16:40:00 -07:00
Simon Willison
2440eb4f48 Help tweak and ran cog 2023-09-03 16:40:00 -07:00
Simon Willison
3d379fbddc In progress llm embed-multi, refs #215 2023-09-03 16:40:00 -07:00
Simon Willison
156bed7c65 Populate content_hash with embed_multi, refs #217 2023-09-03 14:43:29 -07:00
Simon Willison
53fc9cbab7 Fixed hookspec docstrings 2023-09-03 14:04:23 -07:00
Simon Willison
213e0b0c75 embed-db delete-collection command and .delete() method, closes #219 2023-09-03 12:55:48 -07:00
Simon Willison
87af2ddda9 De-register functions after migration, refs #217
Also refs https://github.com/simonw/sqlite-utils/issues/589
2023-09-03 12:33:06 -07:00
Simon Willison
06d35c890a Homebrew badge, closes #218 2023-09-03 11:50:18 -07:00
Simon Willison
573659c84d Remove obsolete debugging code 2023-09-03 10:58:46 -07:00
Simon Willison
a5d6b580ba Store content_hash in embeddings table, refs #217
Uses new migrations feature from https://github.com/simonw/sqlite-migrate/issues/9
2023-09-03 10:50:51 -07:00
Simon Willison
26332045dd llm embed --metadata option, closes #209 2023-09-03 07:43:23 -07:00
Simon Willison
3224f82cff Ensure cog runs against docs/*.md as well 2023-09-03 07:37:59 -07:00
Simon Willison
b7e6c1675b Show SQL schema for embeddings in docs 2023-09-02 20:48:00 -07:00
Simon Willison
73a9043108 Store updated timestamp on embeddings, closes #211 2023-09-02 20:40:33 -07:00
Simon Willison
51488c579b Collection now defaults to in-memory DB, closes #213 2023-09-02 15:43:20 -07:00
Simon Willison
8bdaca1f31
orca-mini-7b in index.md
Refs #195
2023-09-02 11:47:06 -07:00
Simon Willison
1cd4596379
Release 0.9a0
Refs #185, #190, #191
2023-09-02 10:52:36 -07:00
Simon Willison
e49c816e18 Drop llm.EmbeddingModel.embedding_size property, closes #208 2023-09-02 08:45:17 -07:00
Simon Willison
3d56d6cc24 Collection design tweaks + llm embed/similar now use it, closes #204 2023-09-02 08:30:56 -07:00
Simon Willison
2f178a9e9b Corrected type annotations for embed_multi, refs #202 2023-09-01 20:27:35 -07:00
Simon Willison
6b042a264a Fixed -i and -i - modes for llm embed command 2023-09-01 20:24:58 -07:00
Simon Willison
3b2d5bf7f9 embed_multi and embed_multi_with_metadata, closes #202 2023-09-01 20:15:28 -07:00
Simon Willison
4be89facb5 Fixed and finished llm similar command, closes #190 2023-09-01 19:01:16 -07:00
Simon Willison
3ee92152e8 Error conditions for 'llm similar', refs #190 2023-09-01 18:31:59 -07:00
Simon Willison
de6d257dde collection.similar now returns List[Entry], closes #203 2023-09-01 18:06:56 -07:00
Simon Willison
d2f3d319c2 Test and docs for collection.embed(metadata=), refs #203 2023-09-01 17:57:54 -07:00
Simon Willison
4955a5fa6c Docs and test for store=True, refs #203 2023-09-01 17:52:43 -07:00
Simon Willison
212cd617f3 Initial Python embeddings API docs, refs #191 2023-09-01 17:25:45 -07:00
Simon Willison
ae1e7dadb4 Fixed tests for similar, refs #191 2023-09-01 16:28:11 -07:00
Simon Willison
0ec516559a Collection.similar methods, refs #191 2023-09-01 16:26:58 -07:00
Simon Willison
7a4429f100 Fix mypy errors
Refs https://github.com/simonw/llm/issues/191#issuecomment-1703266224
2023-09-01 13:14:59 -07:00
Simon Willison
6f761702dc Initial Collection class plus test, refs #191 2023-09-01 13:04:05 -07:00
Simon Willison
c25e7c4713 Ran cog, refs #190 2023-08-31 23:13:20 -07:00
Simon Willison
2463b28bf0 Fix for llm similar tils2 -c python, refs #190 2023-08-31 23:12:05 -07:00
Simon Willison
5e82929eca First working version of llm similar, refs #190 2023-08-31 22:57:00 -07:00
Simon Willison
ec15707588 next(iter(...)), refs #200 2023-08-31 22:55:58 -07:00