Upload folder using huggingface_hub

README.md

@@ -0,0 +1,21 @@
+---
+license: apache-2.0
+base_model: convaiinnovations/laya
+library_name: onnx
+tags: [onnx, onnxruntime-web, webgpu, laya]
+---
+# Laya for WebGPU in the browser (int8 ONNX, fp32 embeddings)
+
+Unofficial copy of [convaiinnovations/laya](https://huggingface.co/convaiinnovations/laya) (Apache-2.0,
+Copyright ConvAI Innovations) for onnxruntime-web. Used by https://archevel.github.io/laya/.
+
+Made from [harshpreet931/cut-laya-onnx](https://huggingface.co/harshpreet931/cut-laya-onnx)
+(revision `192138dfb32a0b2f73425ba70345946d415bfde1`: 8-bit weight-only MatMulNBits, split encoder/head for
+[laya-ts](https://github.com/NandhaKishorM/laya/tree/main/laya-ts)) with one change: the token-embedding table in
+`encoder.onnx` is widened from fp16 to fp32 (lossless). With the fp16 table, onnxruntime-web's WebGPU Gather
+requires the `shader-f16` feature, which Chrome does not expose on e.g. Linux with NVIDIA GPUs.
+Script: `tools/embeddings_to_fp32.py` in https://github.com/archevel/laya.
+
+Outputs differ slightly from the PyTorch checkpoint because of the 8-bit weights.
+
+Licensed under the Apache License, Version 2.0, like the original.

encoder.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:17f8032808a9b36ec51376b5c42ccb3181e6706054ee883f8259d5c058506159
+size 596133441

head.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ff9e93e3bd54014a8416d8076cd33ad618f4ab94fa26a0f2047c3f74d268bfbe
+size 36942512

rl_agent_config.json

@@ -0,0 +1,33 @@
+{
+  "encoder": "answerdotai/ModernBERT-large",
+  "head_layers": 2,
+  "max_len": 512,
+  "head_max_len": 192,
+  "max_prefixes": 6,
+  "act_costs": {
+    "escalate": 0.5
+  },
+  "cost_wrong_act": 3.0,
+  "amp_dtype": "bf16",
+  "model_name": "rl-agent",
+  "temperature": [
+    1.6369030475616455,
+    1.2514300346374512,
+    1.983399510383606
+  ],
+  "temperature_by_options": {
+    "choice:3-5": 1.7601518630981445,
+    "choice:6-10": 1.0000158548355103,
+    "score:3-5": 1.2514300346374512,
+    "noul:2": 1.983399510383606,
+    "choice:11+": 0.10058280825614929,
+    "choice:2": 1.9063563346862793
+  },
+  "training": {
+    "updates": 7313,
+    "epochs_completed": 1,
+    "hours": 1.96,
+    "world_size": 1,
+    "fine_tuned_from_checkpoint": true
+  }
+}