Mixtral 8x22B is a large-scale language model from Mistral AI. It consists of 8 experts, each 22 billion parameters, with each token using 2 experts at a time.
It was released via X(opens in new tab).
#moe
Modalities
Context
66K
Released
Apr 10, 2024
Knowledge Cutoff
Jan 2024
Mixtral 8x22B is a large-scale language model from Mistral AI. It consists of 8 experts, each 22 billion parameters, with each token using 2 experts at a time. It was released via X. #moe
Mixtral 8x22B (base) has a 65,536 token context window.
Mistral Medium 3.5, Mistral Small 4, Ministral 3 14B 2512 and 15 more are other text models from Mistral AI.
Mixtral 8x22B (base) was released on April 10, 2024. Its knowledge cutoff is January 31, 2024.
Token volume and request traffic to this model over time.