Installation
First install the NodeJs package:Open Source Models
This includes Open source LLMs like Mistral, Llama, etc.
Free to use, and runs locally on your machine.
Free to use, and runs locally on your machine.
Paid Models
This includes paid LLMs like GPT 4, Claude, etc.
Cost money and are accessible via an API.
Cost money and are accessible via an API.
Open Source Models
This section provides a quickstart example of usingLlama3.2
as the Open source LLM and nomic-embed-text
as the Open source embedding model.
These models are free and can be run locally using Ollama.