The library supports generating embeddings using the Hugging Face Inference API. By default it uses the sentence-transformers/distilbert-base-nli-mean-tokens model but you can pass it a model parameter to use any other model available on the Hugging Face model hub.

To use Hugging face embedding models via its Inference API, you need to get a free token. You can get this API Token by signing up for hugging face and visiting this page. Set it to the environment like so -

HUGGINGFACEHUB_API_KEY="<Your hf key>"

​
Install Huggingface addon

npm install @llm-tools/embedjs-huggingface

​
Usage

import { RAGApplicationBuilder } from '@llm-tools/embedjs';
import { HuggingFaceEmbeddings } from '@llm-tools/embedjs-huggingface';
import { HNSWDb } from '@llm-tools/embedjs-hnswlib';

const app = await new RAGApplicationBuilder()
.setEmbeddingModel(new HuggingFaceEmbeddings())

Was this page helpful?

OllamaVertex AI