MuleSoft Inference Connector

MuleSoft AI Chain (MAC) Project

MuleSoft Inference Connector

MuleSoft Inference Connector provides access to Inference Offering for Large Language Models i.e. Groq, Hugging Face, Github Models, etc.

The MuleSoft Inference Connector supports the following Inference Offerings:

Supported Inference Providers

• AI21Labs
• Anthropic
• Azure AI Foundry
• Azure OpenAI
• Cerebras
• Cohere
• Databricks
• DeepInfra
• DeepSeek
• Docker Models
• Fireworks
• Gemini
• GitHub Models
• GPT4ALL
• Groq AI
• Heroku AI
• Hugging Face
• LM Studio
• Mistral
• NVIDIA
• Ollama
• OpenAI
• OpenAI Compatible Endpoints
• OpenRouter
• Perplexity
• Portkey
• Swisscom AI Platform
• Together.ai
• Vertex AI Express
• XAI
• Xinference
• ZHIPU AI

Supported Moderation Providers

• Mistral AI
• OpenAI

Supported Vision Model Providers

• Anthropic
• Azure AI Foundry
• Gemini
• GitHub Models
• Groq AI
• Hugging Face
• Mistral
• Ollama
• OpenAI
• OpenRouter
• Portkey
• Vertex AI Express
• XAI

Supported Image Models Providers

• Heroku AI
• Hugging Face
• OpenAI
• Stability_AI
• XAI

HTTPS Security

The MuleSoft Inference Connector support TLS for Mule Apps

Requirements

• The supported version for Java SDK is Java 17.
• Compilation of the connector has to be done with Java 17.
• Minimum Mule Runtime version 4.9.4 is needed.

Installation (using maven central dependency)

<dependency>
   <groupId>io.github.mulesoft-ai-chain-project</groupId>
   <artifactId>mule4-inference-connector</artifactId>
   <version>{version}</version>
   <classifier>mule-plugin</classifier>
</dependency>

Installation (building locally)

To use this connector, first build and install the connector into your local maven repository. Then add the following dependency to your application's pom.xml:

<dependency>
    <groupId>com.mulesoft.connectors</groupId>
    <artifactId>mule4-inference-connector</artifactId>
    <version>{version}</version>
    <classifier>mule-plugin</classifier>
</dependency>

Formatting

The connector uses formatter-maven-plugin for formatting. To format files use following maven command :

mvn formatter:format

Import Sorting

The connector uses impsort-maven-plugin for sorting imports. To sort imports use following maven command :

mvn impsort:sort

Installation into private Anypoint Exchange

You can also make this connector available as an asset in your Anyooint Exchange.

This process will require you to build the connector as above, but additionally you will need to make some changes to the pom.xml. For this reason, we recommend you fork the repository.

Then, follow the MuleSoft documentation to modify and publish the asset.

Documentation

• Check out the complete documentation in mac-project.ai
• Learn from the Getting Started YouTube Playlist

---

Stay tuned!

• 🌐 Website: mac-project.ai
• 📺 YouTube: @MuleSoft-MAC-Project
• 💼 LinkedIn: MAC Project Group