Yougori's picture
Add files using upload-large-folder tool
e7654c2 verified
Raw History Blame Contribute Delete
833 Bytes
Ling-mini-2.0 Megakernel
Copyright 2026 Yougori
This repository contains a 4-bit version of Ling-mini-2.0
(https://huggingface.co/inclusionAI/Ling-mini-2.0), Copyright (c) 2025 inclusionAI, licensed
under the MIT License (see LICENSE-Ling).
Changes from the original: the weights of every attention, MLP and expert matrix and of the word
table were rounded to 4 bits with one fp16 scale per 64 numbers and repacked in the megakernel's
layout, and the word table's hidden dimensions are stored in a different order. The router, its
bias, the normalization gains and the input embeddings are unchanged in value. config.json,
generation_config.json and the tokenizer files are inclusionAI's, unchanged.
The kernel (megakernel_ling.cu, megakernel_ling.dll) and the Python code are licensed under the
Apache License 2.0 (see LICENSE).