❓ FAQs

Collections of all the frequently asked questions

How to use MistralAI language model?

index.ts

import 'dotenv/config';
import { RAGApplicationBuilder } from '@llm-tools/embedjs';
import { Mistral } from '@llm-tools/embedjs-mistral';
import { WebLoader } from '@llm-tools/embedjs-loader-web';
import { HNSWDb } from '@llm-tools/embedjs-hnswlib';

const llmApplication = await new RAGApplicationBuilder()
    .setModel(new Mistral({ modelName: 'mistral-medium' }))
    .setVectorDatabase(new HNSWDb())
    .build();

await llmApplication.addLoader(new WebLoader({ urlOrContent: 'https://en.wikipedia.org/wiki/Tesla,_Inc.' }));

console.log(await llmApplication.query('Who founded Tesla?'));

How to use GPT-4o as the Language model?

Use the model gpt-4o provided my openai.

index.ts

import 'dotenv/config';
import { RAGApplicationBuilder } from '@llm-tools/embedjs';
import { OpenAi, OpenAiEmbeddings } from '@llm-tools/embedjs-openai';
import { WebLoader } from '@llm-tools/embedjs-loader-web';
import { HNSWDb } from '@llm-tools/embedjs-hnswlib';

const llmApplication = await new RAGApplicationBuilder()
    .setModel(new OpenAi({ modelName: 'gpt-4o' }))
    .setEmbeddingModel(new OpenAiEmbeddings())
    .setVectorDatabase(new HNSWDb())
    .build();

await llmApplication.addLoader(new WebLoader({ urlOrContent: 'https://en.wikipedia.org/wiki/Tesla,_Inc.' }));

console.log(await llmApplication.query('Who founded Tesla?'));

I don't have OpenAI credits. How can I use a local model?

index.ts

import { RAGApplicationBuilder } from '@llm-tools/embedjs';
import { OllamaEmbeddings } from '@llm-tools/embedjs-ollama';
import { WebLoader } from '@llm-tools/embedjs-loader-web';

const ragApplication = await new RAGApplicationBuilder()
    .setModel(new Ollama({ modelName: "llama3.2", baseUrl: 'http://localhost:11434' }))
    .setEmbeddingModel(new OllamaEmbeddings({ model: 'nomic-embed-text', baseUrl: 'http://localhost:11434' }))
    .build();

await ragApplication.addLoader({ urlOrContent: 'https://www.forbes.com/profile/elon-musk' })
await ragApplication.addLoader({ urlOrContent: 'https://en.wikipedia.org/wiki/Elon_Musk' })

await ragApplication.query('What is the net worth of Elon Musk today?')

Still have questions?

If docs aren’t sufficient, please feel free to reach out to us using one of the following methods:

Slack

Join our slack community