Skip to main content
You can load most images using an LLM to describe the contents of the image. This LLM by default is the one used with the application, but a special LLM can also be specified for the content description. To load images, follow the steps below.

​
Install Image addon

npm install @llm-tools/embedjs-loader-image

​
Usage

​
Load from a local file

import { RAGApplicationBuilder } from '@llm-tools/embedjs';
import { ImageLoader } from '@llm-tools/embedjs-loader-image';
import { OpenAiEmbeddings } from '@llm-tools/embedjs-openai';
import { HNSWDb } from '@llm-tools/embedjs-hnswlib';

const app = await new RAGApplicationBuilder()
.setModel(SIMPLE_MODELS.OPENAI_GPT4_O)
.setEmbeddingModel(new OpenAiEmbeddings())
.setVectorDatabase(new HNSWDb())
.build();

app.addLoader(new ImageLoader({ filePathOrUrl: '/path/to/file.jpeg' }))
⌘I