Tencent Hunyuan Hy3 preview model released and open source Tencent officially released and open source Hunyuan Hy3 preview language model

Tencent Hunyuan Hy3 preview model released and open source Tencent officially released and open source Hunyuan Hy3 preview language model. As the first hybrid expert model (MoE) after architectural reconstruction, the model has a total parameter volume of 295B, an activation parameter of 21B, and supports a context length of 256K. Its core capabilities are positioned in complex reasoning and agent applications, and its performance has been significantly improved in reasoning tasks and code development scenarios in science and engineering such as mathematics and science. Affected by the deep collaboration between the model architecture and the inference framework, the inference performance of Hy3 preview has been greatly optimized, with the first token delay of products such as CodeBuddy reduced by 54%. Currently, the model has been published on Yuanbao, Tencent Documents, QQ...