kimi_k2¶
kimi_k2
¶
Kimi K2 (model_type kimi_k2): DeepSeek-V3's architecture under Moonshot's own model type.
Kimi K2 and its successors' language models (K2.5, K2.6, K2.7-Code) are
DeepSeek-V3's DeepseekV3ForCausalLM with Moonshot's tokenizer; their configs say
kimi_k2. transformers builds them with its native DeepSeek-V3 classes: the
multimodal kimi_k25 checkpoints through Kimi_K25Config, whose text_config
is a DeepseekV3Config with model_type deepseek_v3 (the wrapper resolves by
its own type, to kimi_k25.py, which re-exports this module), and the text-only K2
checkpoints from a DeepseekV3ForCausalLM loaded directly, since
AutoConfig maps no kimi_k2. The tree, the envoys and the sizes are
DeepSeek-V3's (deepseek_v3.py); this module names them under kimi_k2,
because the family registry is the module's file name.