OpenLLM

OpenLLM lets Dify connect to OpenLLM-compatible model endpoints for custom model inference.

Features

• Provides llm, text-embedding models in Dify.
• Supports customizable model configuration.

Setup

1. Install this plugin from the Dify Marketplace.
2. Get the required credentials from OpenLLM.
3. Add the credentials in the plugin settings.
4. Save the configuration.

Usage

Select OpenLLM as the model provider in Dify, choose an available model, and use it in applications, agents, or workflows.

Privacy

This plugin sends the inputs required by the selected operation to the upstream service. Review the upstream service's privacy policy before use.