I'm excited to announce the launch of https://chat.ethux.net, a platform that demonstrates the capabilities of locally hosted large language models (LLMs) and the https://mistral.ai API.

At ETHUX, we used the open-source ChatUI created by Hugging Face ( https://huggingface.co ) as the foundation for our chat interface. You can also try their version at https://huggingface.co/chat. The key difference between our ChatUI and Hugging Face's version is that ours supports the Mistral-medium model, which is accessible only through the Mistral API.

Mistral medium is an impressive model that rivals GPT-4 in most use cases and easily outperforms GPT-3.5. The best part? You can use MistralMedium for free on https://chat.ethux.net until our credit limit is reached. :D

But that's not all! Our ChatUI can be hosted internally with your own LLMs to ensure the privacy of your data. If you're curious about how to do this, feel free to reach out to me at gijsbert [at] ethux.nl or explore the following resources:

• GitHub repository for ChatUI: https://github.com/huggingface/chat-ui
• Mistral.ai page on Hugging Face or Mistral Console for API access: https://huggingface.co/mistralai or https://console.mistral.ai/ (check the .env.local file for setup instructions)

Happy experimenting!

MONGODB_URL = mongodb://mongo:27017
MODELS = `[{
    "name": "mistral-tiny",
    "DisplayName": "mistral-tiny",
    "endpoints": [{
        "type" : "openai",
        "baseURL": "https://api.mistral.ai/v1"
      }]
},
      {
    "name": "mistral-small",
    "DisplayName": "mistral-small",
    "endpoints": [{
        "type" : "openai",
        "baseURL": "https://api.mistral.ai/v1"
        }]
      },
      {
    "name": "mistral-medium",
    "DisplayName": "mistral-medium",
    "endpoints": [{
        "type" : "openai",
        "baseURL": "https://api.mistral.ai/v1"
      }]
}]`

ENABLE_ASSISTANTS = true
PUBLIC_APP_DESCRIPTION = "Made possible by PlanetNode with ❤️"
USE_LOCAL_WEBSEARCH = true
OPENAI_API_KEY = <secret>
PUBLIC_ORIGIN=https://chat.ethux.net
PUBLIC_SHARE_PREFIX=https://chat.ethux.net/chat
APP_BASE=""
PUBLIC_APP_NAME="Mistral Chat"
PUBLIC_APP_COLOR=orange
RATE_LIMIT=3