I'm having a fantastic time with this model.
I'm having a fantastic time with this model.
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
I've been using TheBlokes Q8 of https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B, but now this one (https://huggingface.co/Weyaxi/OpenHermes-2.5-neural-chat-7b-v3-1-7B) I think is killing it. Has anyone else tested it?
You're viewing a single thread.
Hmm had interesting results from both of those base models, haven't tried the combo yet, will start some exllamav2 quants to test
What's it doing well at?
quant link for anyone who may want: https://huggingface.co/bartowski/OpenHermes-2.5-neural-chat-7b-v3-1-7B-exl2
I haven't tried neural-chat, but the combined model seems to be better (anecdotally) than OH2.5/Mistral at following instructions, reasoning, some of the overall quirks with llama.cpp seem to be ironed out with it too.