To be pitched to target partnersAWS BedrockAlibaba CloudSui
AI can make mistakes. Verify outputs before acting on them.
Add Models (Endpoints)
Connect local models first, or add a cloud API.
LOCAL
Run a model on your own computer with Ollama - free, private, and works offline.
1
Install OllamaDownload for your OS from ollama.com/download and run the installer.
2
Download a modelIn a terminal, pull a small model to start (-2 GB):ollama pull qwen2.5:3b
3
Start the server with the bundled scriptRun it from the project folder - it frees port 11434 first, then starts Ollama with browser access enabled. Double-clicking the file works too. Leave that terminal open while you chat../start-ollama.shRather type it yourself? Same thing in one line - OLLAMA_ORIGINS is what lets the browser reach it:pkill -f ollama; OLLAMA_ORIGINS=* ollama serve
4
Connect it herePaste this endpoint in the field above, then click Add:http://127.0.0.1:11434/v1Use the numbers, not localhost: on Windows localhost usually resolves to IPv6 ::1 first, while Ollama listens on IPv4 only - so localhost gets refused before it ever reaches the server.
Tip: bigger models (llama3.1:8b, qwen2.5:7b) are smarter but need more RAM. Start small and scale up.
API
Added Models (Endpoints)
Manage the endpoints you've added.
Ollama not detected
We can't reach Ollama on this computer yet.
One-click downloads pull the model straight through Ollama, so it needs to be installed and running first.
Already have it? Run the bundled script from the project folder - ./start-ollama.sh - it frees the port and starts Ollama with browser access in one go, then retry below. Prefer one line? pkill -f ollama; OLLAMA_ORIGINS=* ollama serve.