Jan

The jan provider connects to the Jan local server.

1. Jan

2. Open Jan and download the models you plan to use. You will find the model identifier in the model description page.

3. Click on the Local API Server icon (lower left), then Start Server.

   Keep the desktop application running!

To use Jan models, use the jan:modelid syntax. If you change the default server URL, you can set the JAN_API_BASE environment variable.

.env

JAN_API_BASE=http://localhost:1234/v1

Limitations

• Ignore prediction of output tokens
• top_p ignored