A continuation of OpenHermes 2 model, trained on additional code datasets. Potentially the most interesting finding from training on a good ratio (est. of around 7-14% of the total dataset) of code instruction was that it has boosted several non-code benchmarks, including TruthfulQA, AGIEval, and GPT4All suite. It did however reduce BigBench benchmark score, but the net gain overall is significant.
Modalities
Context
4K
Released
Nov 20, 2023
Knowledge Cutoff
Sep 2023
A continuation of OpenHermes 2 model, trained on additional code datasets. Potentially the most interesting finding from training on a good ratio (est. of around 7-14% of the total dataset) of code instruction was that it has boosted several non-code benchmarks, including TruthfulQA, AGIEval, and GPT4All suite.
OpenHermes 2.5 Mistral 7B has a 4,096 token context window.
OpenHermes 2.5 Mistral 7B was released on November 20, 2023. Its knowledge cutoff is September 30, 2023.
Token volume and request traffic to this model over time.