Hopiu/llm
1
0
Fork 0
mirror of https://github.com/Hopiu/llm.git synced 2026-05-14 00:33:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Link to blog post about building Jina embeddings plugin

Browse source
This commit is contained in:
Simon Willison 2023-10-27 07:40:33 -07:00 committed by GitHub
parent e75de8373a
commit 8e84c00771
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
docs/embeddings/writing-plugins.md
View file

@ -48,6 +48,8 @@ cat file.txt | llm embed -m all-MiniLM-L6-v2
```
[llm-sentence-transformers](https://github.com/simonw/llm-sentence-transformers) is a complete example of a plugin that provides an embedding model.
[Execute Jina embeddings with a CLI using llm-embed-jina](https://simonwillison.net/2023/Oct/26/llm-embed-jina/#how-i-built-the-plugin) talks through a similar process to add support for the [Jina embeddings models](https://jina.ai/news/jina-ai-launches-worlds-first-open-source-8k-text-embedding-rivaling-openai/).
## Embedding binary content
If your model can embed binary content, use the `supports_binary` property to indicate that:
@ -63,4 +65,4 @@ class ClipEmbeddingModel(llm.EmbeddingModel):
If your model accepts binary, your `.embed_batch()` model may be called with a list of Python bytestrings. These may be mixed with regular strings if the model accepts both types of input.
[llm-clip](https://github.com/simonw/llm-clip) is an example of a model that can embed both binary and text content.
[llm-clip](https://github.com/simonw/llm-clip) is an example of a model that can embed both binary and text content.