Installation

First install the NodeJs package:

npm i @llm-tools/embedjs

Once you have installed the package, depending upon your preference you can either use:

Open Source Models

This section provides a quickstart example of using Llama3.2 as the Open source LLM and nomic-embed-text as the Open source embedding model.

These models are free and can be run locally using Ollama.

You can also run these models using Huggingface. Read more about using Huggingface embeddings and LLMs with EmbedJs here and here.

In this section, we will use both an LLM and embedding model from OpenAI.

Next Steps

Now that you have created your first app, you can follow any of the links: