enconvo's picture
EmbeddingGemma 2 for MLX: bf16 with an 8-bit token table, audio removed
d0090d2 verified
Raw History Blame Contribute Delete
1.07 kB
EmbeddingGemma 2
Copyright Google LLC
This model is EmbeddingGemma 2 by Google (google/embeddinggemma-2, revision
914f7f89142e33e77833254d9c9b90c3cef7303b), licensed under the Apache License, Version 2.0. A copy of
the licence is in the LICENSE file beside this one, and at
http://www.apache.org/licenses/LICENSE-2.0.
Modifications by Enconvo (THE GREAT LIONHEART PTE. LTD.): converted to MLX by
mlx-community (mlx-community/embeddinggemma-2-bf16, revision 1a4ffddb7905d3f63486748deabe091a01fb6201), then
repacked for Enconvo: the audio encoder (audio_tower.*, embed_audio.*) was
removed, and the token embedding table (language_model.embed_tokens) is stored
with 8-bit affine quantization (group size 64). Every other weight is unchanged
in bfloat16. config.json records both changes.
Unless required by applicable law or agreed to in writing, the model is
distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND,
either express or implied. See the License for the specific language governing
permissions and limitations under the License.