21 commits

Author	SHA1	Message	Date
Simon Willison	0eda99e91c	Default embedding model finishing touches, closes #222	2023-09-03 17:21:47 -07:00
Simon Willison	8ce7046d13	Documentation for llm embed-multi, refs #215	2023-09-03 16:40:00 -07:00
Simon Willison	0da1ed7d98	--remove-default for llm embed-models default, refs #222	2023-09-03 16:40:00 -07:00
Simon Willison	213e0b0c75	embed-db delete-collection command and .delete() method, closes #219	2023-09-03 12:55:48 -07:00
Simon Willison	a5d6b580ba	Store content_hash in embeddings table, refs #217 ... Uses new migrations feature from https://github.com/simonw/sqlite-migrate/issues/9	2023-09-03 10:50:51 -07:00
Simon Willison	26332045dd	llm embed --metadata option, closes #209	2023-09-03 07:43:23 -07:00
Simon Willison	b7e6c1675b	Show SQL schema for embeddings in docs	2023-09-02 20:48:00 -07:00
Simon Willison	51488c579b	Collection now defaults to in-memory DB, closes #213	2023-09-02 15:43:20 -07:00
Simon Willison	e49c816e18	Drop llm.EmbeddingModel.embedding_size property, closes #208	2023-09-02 08:45:17 -07:00
Simon Willison	3d56d6cc24	Collection design tweaks + llm embed/similar now use it, closes #204	2023-09-02 08:30:56 -07:00
Simon Willison	3b2d5bf7f9	embed_multi and embed_multi_with_metadata, closes #202	2023-09-01 20:15:28 -07:00
Simon Willison	4be89facb5	Fixed and finished llm similar command, closes #190	2023-09-01 19:01:16 -07:00
Simon Willison	de6d257dde	collection.similar now returns List[Entry], closes #203	2023-09-01 18:06:56 -07:00
Simon Willison	d2f3d319c2	Test and docs for collection.embed(metadata=), refs #203	2023-09-01 17:57:54 -07:00
Simon Willison	4955a5fa6c	Docs and test for store=True, refs #203	2023-09-01 17:52:43 -07:00
Simon Willison	212cd617f3	Initial Python embeddings API docs, refs #191	2023-09-01 17:25:45 -07:00
Simon Willison	7a4429f100	Fix mypy errors ... Refs https://github.com/simonw/llm/issues/191#issuecomment-1703266224	2023-09-01 13:14:59 -07:00
Simon Willison	817aff8bae	Embeddings now happen in batches, closes #200	2023-08-31 22:27:06 -07:00
Simon Willison	02f671219e	Improvements to embedding docs, refs #185	2023-08-31 21:55:39 -07:00
Simon Willison	5a9269a2ce	Typo	2023-08-31 16:58:02 -07:00
Simon Willison	77cf56e54a	Initial CLI support and plugin hook for embeddings, refs #185 ... * Embeddings plugin hook + OpenAI implementation * llm.get_embedding_model(name) function * llm embed command, for returning embeddings or saving them to SQLite * Tests using an EmbedDemo embedding model * llm embed-models list and emeb-models default commands * llm embed-db path and llm embed-db collections commands	2023-08-27 22:24:10 -07:00