Simon Willison
3d379fbddc
In progress llm embed-multi, refs #215
2023-09-03 16:40:00 -07:00
Simon Willison
156bed7c65
Populate content_hash with embed_multi, refs #217
2023-09-03 14:43:29 -07:00
Simon Willison
53fc9cbab7
Fixed hookspec docstrings
2023-09-03 14:04:23 -07:00
Simon Willison
213e0b0c75
embed-db delete-collection command and .delete() method, closes #219
2023-09-03 12:55:48 -07:00
Simon Willison
87af2ddda9
De-register functions after migration, refs #217
...
Also refs https://github.com/simonw/sqlite-utils/issues/589
2023-09-03 12:33:06 -07:00
Simon Willison
06d35c890a
Homebrew badge, closes #218
2023-09-03 11:50:18 -07:00
Simon Willison
573659c84d
Remove obsolete debugging code
2023-09-03 10:58:46 -07:00
Simon Willison
a5d6b580ba
Store content_hash in embeddings table, refs #217
...
Uses new migrations feature from https://github.com/simonw/sqlite-migrate/issues/9
2023-09-03 10:50:51 -07:00
Simon Willison
26332045dd
llm embed --metadata option, closes #209
2023-09-03 07:43:23 -07:00
Simon Willison
3224f82cff
Ensure cog runs against docs/*.md as well
2023-09-03 07:37:59 -07:00
Simon Willison
b7e6c1675b
Show SQL schema for embeddings in docs
2023-09-02 20:48:00 -07:00
Simon Willison
73a9043108
Store updated timestamp on embeddings, closes #211
2023-09-02 20:40:33 -07:00
Simon Willison
51488c579b
Collection now defaults to in-memory DB, closes #213
2023-09-02 15:43:20 -07:00
Simon Willison
8bdaca1f31
orca-mini-7b in index.md
...
Refs #195
2023-09-02 11:47:06 -07:00
Simon Willison
1cd4596379
Release 0.9a0
...
Refs #185 , #190 , #191
2023-09-02 10:52:36 -07:00
Simon Willison
e49c816e18
Drop llm.EmbeddingModel.embedding_size property, closes #208
2023-09-02 08:45:17 -07:00
Simon Willison
3d56d6cc24
Collection design tweaks + llm embed/similar now use it, closes #204
2023-09-02 08:30:56 -07:00
Simon Willison
2f178a9e9b
Corrected type annotations for embed_multi, refs #202
2023-09-01 20:27:35 -07:00
Simon Willison
6b042a264a
Fixed -i and -i - modes for llm embed command
2023-09-01 20:24:58 -07:00
Simon Willison
3b2d5bf7f9
embed_multi and embed_multi_with_metadata, closes #202
2023-09-01 20:15:28 -07:00
Simon Willison
4be89facb5
Fixed and finished llm similar command, closes #190
2023-09-01 19:01:16 -07:00
Simon Willison
3ee92152e8
Error conditions for 'llm similar', refs #190
2023-09-01 18:31:59 -07:00
Simon Willison
de6d257dde
collection.similar now returns List[Entry], closes #203
2023-09-01 18:06:56 -07:00
Simon Willison
d2f3d319c2
Test and docs for collection.embed(metadata=), refs #203
2023-09-01 17:57:54 -07:00
Simon Willison
4955a5fa6c
Docs and test for store=True, refs #203
2023-09-01 17:52:43 -07:00
Simon Willison
212cd617f3
Initial Python embeddings API docs, refs #191
2023-09-01 17:25:45 -07:00
Simon Willison
ae1e7dadb4
Fixed tests for similar, refs #191
2023-09-01 16:28:11 -07:00
Simon Willison
0ec516559a
Collection.similar methods, refs #191
2023-09-01 16:26:58 -07:00
Simon Willison
7a4429f100
Fix mypy errors
...
Refs https://github.com/simonw/llm/issues/191#issuecomment-1703266224
2023-09-01 13:14:59 -07:00
Simon Willison
6f761702dc
Initial Collection class plus test, refs #191
2023-09-01 13:04:05 -07:00
Simon Willison
c25e7c4713
Ran cog, refs #190
2023-08-31 23:13:20 -07:00
Simon Willison
2463b28bf0
Fix for llm similar tils2 -c python, refs #190
2023-08-31 23:12:05 -07:00
Simon Willison
5e82929eca
First working version of llm similar, refs #190
2023-08-31 22:57:00 -07:00
Simon Willison
ec15707588
next(iter(...)), refs #200
2023-08-31 22:55:58 -07:00
Simon Willison
817aff8bae
Embeddings now happen in batches, closes #200
2023-08-31 22:27:06 -07:00
Simon Willison
8099384391
Add foreign key from embeddings to collections, refs #185
2023-08-31 22:16:25 -07:00
Simon Willison
02f671219e
Improvements to embedding docs, refs #185
2023-08-31 21:55:39 -07:00
dependabot[bot]
d6cd3a0137
Bump sphinx and furo ( #199 )
...
Bumps the python-packages group with 2 updates: [sphinx](https://github.com/sphinx-doc/sphinx ) and [furo](https://github.com/pradyunsg/furo ).
Updates `sphinx` from 7.2.2 to 7.2.5
- [Release notes](https://github.com/sphinx-doc/sphinx/releases )
- [Changelog](https://github.com/sphinx-doc/sphinx/blob/master/CHANGES )
- [Commits](https://github.com/sphinx-doc/sphinx/compare/v7.2.2...v7.2.5 )
Updates `furo` from 2023.8.17 to 2023.8.19
- [Release notes](https://github.com/pradyunsg/furo/releases )
- [Changelog](https://github.com/pradyunsg/furo/blob/main/docs/changelog.md )
- [Commits](https://github.com/pradyunsg/furo/compare/2023.08.17...2023.08.19 )
---
updated-dependencies:
- dependency-name: sphinx
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: python-packages
- dependency-name: furo
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: python-packages
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-31 20:36:03 -07:00
Chris Mungall
439f7951c3
Fix link to ttok repo ( #198 )
...
Thanks, @cmungall
2023-08-31 20:35:39 -07:00
Simon Willison
0cb9a2ea68
Suggest orca-mini-7b because ggml-vicuna-7b-1 is no longer available, closes #195
2023-08-31 20:30:46 -07:00
Simon Willison
b30f6894f7
Fixed bug if LLM directory does not exist, closes #193
2023-08-31 20:26:05 -07:00
Simon Willison
5a9269a2ce
Typo
2023-08-31 16:58:02 -07:00
Simon Willison
77cf56e54a
Initial CLI support and plugin hook for embeddings, refs #185
...
* Embeddings plugin hook + OpenAI implementation
* llm.get_embedding_model(name) function
* llm embed command, for returning embeddings or saving them to SQLite
* Tests using an EmbedDemo embedding model
* llm embed-models list and emeb-models default commands
* llm embed-db path and llm embed-db collections commands
2023-08-27 22:24:10 -07:00
Simon Willison
cee5b06604
'just push' command pushes to git only if test/lint passes
2023-08-27 20:20:39 -07:00
Simon Willison
b5260b4eb0
llm-anyscale-endpoints
...
!stable-docs
2023-08-23 13:46:48 -07:00
Simon Willison
7744cf9b79
llm-openrouter in plugin directory
...
Closes #168
!stable-docs
2023-08-21 00:05:35 -07:00
Simon Willison
ebe2e08a1f
Release 0.8
...
Refs #111 , #147 , #153 , #154 , #155 , #158 , #160 , #167 , #173 , #174
2023-08-20 23:53:09 -07:00
Simon Willison
9547b51fa3
sqlite-utils>=3.35.0
...
For this fix:
- https://github.com/simonw/sqlite-utils/issues/577
Refs #60 , #116 , #123
2023-08-20 23:33:42 -07:00
Simon Willison
dff36f0edc
Change of policy: keys.json over-rides environment variables, closes #158
2023-08-20 23:27:21 -07:00
Simon Willison
341dbce2d5
Fix error on pydantic 1.10.2 - refs #169
2023-08-20 23:16:10 -07:00