The model, called Hy4 preview, uses a “mixture-of-experts” design with 770 billion parameters in total, Tencent said, although only about 49 billion are used for any given text request.
Read more at the source
Disclaimer: The content of this post is sourced from external sites and is for informational purposes only. All rights and credits belong to the original authors and publishers.