How to use MistralAI language model?
How to use MistralAI language model?
Copy
import 'dotenv/config';
import { RAGApplicationBuilder } from '@llm-tools/embedjs';
import { Mistral } from '@llm-tools/embedjs-mistral';
import { WebLoader } from '@llm-tools/embedjs-loader-web';
import { HNSWDb } from '@llm-tools/embedjs-hnswlib';
const llmApplication = await new RAGApplicationBuilder()
.setModel(new Mistral({ modelName: 'mistral-medium' }))
.setVectorDatabase(new HNSWDb())
.build();
await llmApplication.addLoader(new WebLoader({ urlOrContent: 'https://en.wikipedia.org/wiki/Tesla,_Inc.' }));
console.log(await llmApplication.query('Who founded Tesla?'));
How to use GPT-4o as the Language model?
How to use GPT-4o as the Language model?
Use the model
gpt-4o provided my openai.Copy
import 'dotenv/config';
import { RAGApplicationBuilder } from '@llm-tools/embedjs';
import { OpenAi, OpenAiEmbeddings } from '@llm-tools/embedjs-openai';
import { WebLoader } from '@llm-tools/embedjs-loader-web';
import { HNSWDb } from '@llm-tools/embedjs-hnswlib';
const llmApplication = await new RAGApplicationBuilder()
.setModel(new OpenAi({ modelName: 'gpt-4o' }))
.setEmbeddingModel(new OpenAiEmbeddings())
.setVectorDatabase(new HNSWDb())
.build();
await llmApplication.addLoader(new WebLoader({ urlOrContent: 'https://en.wikipedia.org/wiki/Tesla,_Inc.' }));
console.log(await llmApplication.query('Who founded Tesla?'));
I don't have OpenAI credits. How can I use a local model?
I don't have OpenAI credits. How can I use a local model?
Copy
import { RAGApplicationBuilder } from '@llm-tools/embedjs';
import { OllamaEmbeddings } from '@llm-tools/embedjs-ollama';
import { WebLoader } from '@llm-tools/embedjs-loader-web';
const ragApplication = await new RAGApplicationBuilder()
.setModel(new Ollama({ modelName: "llama3.2", baseUrl: 'http://localhost:11434' }))
.setEmbeddingModel(new OllamaEmbeddings({ model: 'nomic-embed-text', baseUrl: 'http://localhost:11434' }))
.build();
await ragApplication.addLoader({ urlOrContent: 'https://www.forbes.com/profile/elon-musk' })
await ragApplication.addLoader({ urlOrContent: 'https://en.wikipedia.org/wiki/Elon_Musk' })
await ragApplication.query('What is the net worth of Elon Musk today?')
Still have questions?
If docs aren’t sufficient, please feel free to reach out to us using one of the following methods:Slack
Join our slack community

